-- Logs begin at Sat 2022-09-03 20:01:17 UTC, end at Sat 2022-09-03 20:59:02 UTC. -- Sep 03 20:31:37.313528 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 03 20:31:37.322873 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 20:31:37 2022] *** Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: nodename: dv-osbrick-master-4-ceph Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: machine: x86_64 Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: clock source: unix Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: pcre jit disabled Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: detected number of CPU cores: 4 Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: current working directory: / Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: detected binary path: /usr/bin/uwsgi-core Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: your processes number limit is 47680 Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: your memory page size is 4096 bytes Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: detected max file descriptor number: 2048 Sep 03 20:31:37.323906 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: lock engine: pthread robust mutexes Sep 03 20:31:37.324629 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: thunder lock: enabled Sep 03 20:31:37.324629 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 03 20:31:37.324629 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 20:31:37.372872 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: Python main interpreter initialized at 0x555d7dac39c0 Sep 03 20:31:37.372872 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: python threads support enabled Sep 03 20:31:37.372872 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: your server socket listen backlog is limited to 100 connections Sep 03 20:31:37.372872 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: your mercy for graceful operations on workers is 90 seconds Sep 03 20:31:37.373282 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 20:31:37.373282 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: *** Operational MODE: preforking *** Sep 03 20:31:37.373549 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: *** uWSGI is running in multiple interpreter mode *** Sep 03 20:31:37.373549 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: spawned uWSGI master process (pid: 94918) Sep 03 20:31:37.373736 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 03 20:31:37.375179 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: spawned uWSGI worker 1 (pid: 94930, cores: 1) Sep 03 20:31:37.375179 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: spawned uWSGI worker 2 (pid: 94931, cores: 1) Sep 03 20:31:37.375179 dv-osbrick-master-4-ceph devstack@keystone.service[94918]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 20:31:41.963860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:31:41.963860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: from cryptography.utils import int_from_bytes Sep 03 20:31:41.964723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:31:41.964723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: from cryptography.utils import int_from_bytes Sep 03 20:31:41.965172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:31:41.965172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: from cryptography.utils import int_from_bytes Sep 03 20:31:41.965289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 20:31:41.965289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: from cryptography.utils import int_from_bytes Sep 03 20:31:42.014830 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:31:42.015051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 20:31:42.015136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:31:42.015217 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 20:31:42.015285 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] command line args: [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:31:42.015350 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] command line args: [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 20:31:42.015410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:31:42.015466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 20:31:42.015608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ================================================================================ {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:31:42.015753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ================================================================================ {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 20:31:42.015843 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] admin_token = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.015917 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] admin_token = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] config_dir = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] config_dir = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] config_source = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016464 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] config_source = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] debug = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016610 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] debug = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.016757 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.017020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.017111 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.017177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018287 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018623 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_config_append = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018681 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_config_append = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018808 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_dir = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_dir = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.018995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_file = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_file = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019121 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019243 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019368 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019482 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019752 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019820 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.019880 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020212 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020309 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020545 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020668 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020747 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.020819 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021093 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021464 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021768 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.021972 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] publish_errors = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] publish_errors = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.022997 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023195 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023317 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023685 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.023942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] standard_threads = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] standard_threads = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024162 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024516 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024516 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] use_journal = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024893 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] use_journal = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.024976 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] use_json = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025048 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] use_json = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] use_stderr = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] use_stderr = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] use_syslog = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] use_syslog = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 20:31:42.025672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.025814 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.025969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.026153 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027396 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027734 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.027968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028346 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.028946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029072 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029377 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029526 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029596 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.029899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030246 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030483 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030553 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.030934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031004 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031435 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.031898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032112 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032518 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032600 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032709 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.032989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033216 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033735 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.033972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034252 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034422 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.034992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035249 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035423 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035507 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035901 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.035989 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036126 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036579 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.036989 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037156 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037280 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.037886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038015 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038474 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038635 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.038841 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039352 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039445 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039590 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039680 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039827 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.039911 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040300 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040395 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040638 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.040895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041767 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.041868 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042097 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042253 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042337 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042494 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042585 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042724 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042807 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.042943 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043504 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043661 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.043988 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044694 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044901 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.044987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045558 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.045901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046298 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046377 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046533 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046844 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.046997 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047231 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.047998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048370 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048682 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048827 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.048930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049166 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049318 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049558 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.049871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050375 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.external = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.external = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.050981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051060 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051352 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.password = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.password = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.051947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] auth.token = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] auth.token = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052259 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052488 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052736 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052893 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.052980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053472 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053631 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.053885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054339 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054579 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054659 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.054918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055072 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055300 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055541 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.055867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056270 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056357 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056789 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.056886 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057071 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057312 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057799 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.057886 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058031 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058112 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058272 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058352 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058602 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.058982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059068 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059218 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059546 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.059951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060038 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060184 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060926 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.060999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061238 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.061932 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.062883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063331 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063561 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063717 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.063960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064042 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064448 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064529 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064768 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.064977 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065668 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.065980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066354 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066436 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066590 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066670 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066822 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.066901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067155 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067288 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067526 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067766 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067848 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.067995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068776 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.068958 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069683 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.069940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070403 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070854 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.070934 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071547 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071627 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.071867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072017 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072096 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072785 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.072963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073522 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073682 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.073920 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074846 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.074925 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075411 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075623 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.075949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.076915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077728 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077873 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.077944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078014 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078376 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078757 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.078901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079027 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079520 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.079929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080441 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080525 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.080965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081040 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081590 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.081975 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082047 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082707 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082834 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082913 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.082998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083365 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] role.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083759 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.083900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] role.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084027 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] role.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] role.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084555 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.084999 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085062 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085121 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085395 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085747 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.085871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086104 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086582 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.086946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087281 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087406 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087688 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087814 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.087894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088275 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088504 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.088989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089167 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089358 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089638 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089830 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.089953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090395 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090565 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090729 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090855 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.090935 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091018 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091737 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.091952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092649 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092794 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.092914 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093072 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093169 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093390 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093778 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.093875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094482 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094778 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.094929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095483 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.095924 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096411 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.connection = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096805 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.096958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097089 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097358 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.connection = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097490 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097616 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.097999 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098310 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.098861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.099928 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100070 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100570 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100570 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.100823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94930) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:31:42.101177 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.101177 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.101426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.101565 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 20:31:42.101698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 20:31:42.131815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.132094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.132277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.132539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.132651 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.132991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.141551 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.143844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.172410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.172624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.180562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.180861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.228665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.229883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.282653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.282868 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.286903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.287135 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.359854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.360067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.360270 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.360451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.360694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.360888 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.366494 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.366985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.367110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.367337 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.367529 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.367764 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.385523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.385951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.386235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.386506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.386655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.386732 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.386798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.386924 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.387005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.387080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.387146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.387381 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.388003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.388003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.400128 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.402613 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.413803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.414055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.414301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.414498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.414685 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.414780 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.414924 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415081 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94930) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415154 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415547 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415765 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.415965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 20:31:42.433106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.433298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 20:31:42.433620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.433835 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 20:31:42.434262 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.434388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.434602 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.434858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.437994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.437994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 20:31:42.438566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.438883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 20:31:42.439332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.440004 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.440004 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.440180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.444812 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.445142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.445410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.445713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.450135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.450423 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.450694 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.450980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.456963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.457958 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.460814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.461124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.461405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.461687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.461967 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.462227 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.462435 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.462552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.462710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.462838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.462993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.463122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.463220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.463299 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.463519 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.463648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.463803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.464055 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.464333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.464601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.464890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.465173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.488955 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.490385 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.490671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.495312 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.495856 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.496239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.498103 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.499614 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.499900 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.502511 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.502790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.504602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.504898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.505204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.508171 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.508671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.509164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.509753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.510209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.510694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.511182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.511609 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.511976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.512264 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.516909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.517204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.517499 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.517799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.518978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.519295 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.519588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.519878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.530134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.530411 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.534253 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.537510 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.538014 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.539351 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.539644 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.542273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.543490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.546224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.546798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.547098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.549397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.549695 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.550003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.550438 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.550749 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.551133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.551381 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.555485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.559200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.559499 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.559792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.560078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.560361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.560624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.570601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.571078 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.571513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.571940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.578036 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.578338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.578556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.578856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.580067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.581764 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.583320 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.583591 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.586719 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.586955 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.587092 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.587281 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.587570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.587854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.588488 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.590043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.590337 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.593009 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.593296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.593584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.593888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.594262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.599279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.599561 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.599846 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.600123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.600518 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.600879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.601175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.605916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.606219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.606505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.606789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.607168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.607451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.607744 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.616580 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.619632 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.622737 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.624165 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.624707 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.625662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.625951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.626236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.627676 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.633212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.634200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.634741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.635674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.637187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.637480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.637617 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.637881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.638010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.638506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.638810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.644649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.646164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.648628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.648922 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.649292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.649975 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.651505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.651980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.652420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.656408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94930) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.656694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.656997 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.657273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.657542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.657818 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.658221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.658504 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.658771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.659035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.659315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.659692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.660165 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.660485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.660727 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94930) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.660896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.661039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.668372 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 20:31:42.668628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.668957 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.669238 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.669511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.669793 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.670073 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.670351 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.670637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.670902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.671174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.671437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.671697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.671957 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 20:31:42.699460 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d7dac39c0 pid: 94930 (default app) Sep 03 20:31:42.703741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087410c-68a8-4417-bc34-8571376de0ec None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:42.704027 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087410c-68a8-4417-bc34-8571376de0ec None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:42.704295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087410c-68a8-4417-bc34-8571376de0ec None None] PATH_INFO: `/v3` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:42.708987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sat Sep 3 20:31:42 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:31:42.715937 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555d7dac39c0 pid: 94931 (default app) Sep 03 20:31:49.849246 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:49.850085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:49.850085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:49.852260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:31:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:31:49.862142 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:49.863112 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:49.863112 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:49.941133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: INFO dbcounter [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] Registered counter for database keystone Sep 03 20:31:49.961836 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG oslo_db.sqlalchemy.engines [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:31:49.969170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writer thread running {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:31:50.162137 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG passlib.handlers.bcrypt [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94931) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 20:31:50.162510 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG passlib.handlers.bcrypt [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94931) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 20:31:50.221056 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:31:50.222639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:31:50.361478 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:31:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 20:31:50.915965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:50.993512 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: INFO dbcounter [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] Registered counter for database keystone Sep 03 20:31:51.019326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG oslo_db.sqlalchemy.engines [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94930) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 20:31:51.029828 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writer thread running {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 20:31:51.150292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87922-ddf4-4aa4-a40a-9b93b9011f97 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:51.155144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:51.155773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:51.156048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:51.156323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:51.165266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:51.217368 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 20:31:51.217646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a867337-5b31-49a7-96a7-492e55cfe172 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:51.228104 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Sep 3 20:31:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 20:31:51.235388 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:51.255690 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fed17-24a0-4efb-a7d1-b0b891572a56 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:51.261097 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:51.262235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:51.262520 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:51.262794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] PATH_INFO: `/v3/projects/62e71242b6cf459c81a02ac25c62a69e` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:51.265081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] RBAC: Authorizing `identity:get_project(project_id=62e71242b6cf459c81a02ac25c62a69e)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:51.315220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 20:31:51.315560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7711ab0-8aaf-47c1-a79d-22cb08df3d59 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:51.320396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sat Sep 3 20:31:51 2022] GET /identity/v3/projects/62e71242b6cf459c81a02ac25c62a69e => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:31:53.462014 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f1725-f8ca-4df1-80ca-234920fa594f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:53.462549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f1725-f8ca-4df1-80ca-234920fa594f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:53.462549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f1725-f8ca-4df1-80ca-234920fa594f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:53.468949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:31:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:31:53.478952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:53.479678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:53.479830 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:53.506266 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:31:53.507897 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:31:53.517775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:31:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 20:31:53.839230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f1725-f8ca-4df1-80ca-234920fa594f None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:53.854781 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f1725-f8ca-4df1-80ca-234920fa594f None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:53.860710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b48fe-ebb5-473c-8ea1-b30f73907234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:53.861351 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b48fe-ebb5-473c-8ea1-b30f73907234 admin admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:53.861628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b48fe-ebb5-473c-8ea1-b30f73907234 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:53.861903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b48fe-ebb5-473c-8ea1-b30f73907234 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:53.871532 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b48fe-ebb5-473c-8ea1-b30f73907234 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:53.873923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b48fe-ebb5-473c-8ea1-b30f73907234 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:53.885699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Sep 3 20:31:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 03 20:31:53.892761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:53.908411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b70066-cb88-4d90-9dc2-d1990705635f None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:53.916514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edad2a-0da3-457c-84d5-31d3b274bdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:53.917193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edad2a-0da3-457c-84d5-31d3b274bdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:53.917471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edad2a-0da3-457c-84d5-31d3b274bdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:53.917741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edad2a-0da3-457c-84d5-31d3b274bdf9 admin admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:53.919292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edad2a-0da3-457c-84d5-31d3b274bdf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:53.921184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edad2a-0da3-457c-84d5-31d3b274bdf9 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:53.922738 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sat Sep 3 20:31:53 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:31:56.197905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46597c-79e2-4a52-a517-a8bb1b8e2f1b None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:56.198489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46597c-79e2-4a52-a517-a8bb1b8e2f1b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:56.198489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46597c-79e2-4a52-a517-a8bb1b8e2f1b None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:56.198650 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5c58-5be2-4cd7-8c44-b9f21103eb67 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:56.199007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5c58-5be2-4cd7-8c44-b9f21103eb67 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:56.199241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5c58-5be2-4cd7-8c44-b9f21103eb67 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:56.199761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:31:56.200562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 5/11] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:31:56.205096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:56.205384 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:56.205657 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:56.206210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:56.206493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:56.206767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:56.228709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:31:56.229926 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:31:56.253210 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG passlib.handlers.bcrypt [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94930) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 20:31:56.253622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG passlib.handlers.bcrypt [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94930) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 20:31:56.303205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:31:56.305069 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:31:56.433965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:31:56.436782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:31:56.749107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:56.757257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:56.782531 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:56.854945 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:56.858032 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fe5f-5e4d-4e39-80fb-ade90d97ad15 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:56.866750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510622-a703-4586-8d6a-1b984ccb0b88 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:56.900132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:56.900930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:56.901044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:56.901328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:56.901577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:56.901671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:56.901857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:56.902130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:56.913682 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:31:56.922657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:31:56.923585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:31:56.924396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:31:56.929703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:56.969741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:56.971286 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.010322 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:57.028573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1e48e-ac52-41e3-a364-d6d6ce5aaccc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:57.062348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:57.062951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:57.063230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:57.063496 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:57.064160 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:31:57.064455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:57.065361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:57.065885 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.069528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:31:57.075123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:57.078170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 8/16] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:31:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:31:57.083819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:57.176548 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4e1c5-69f6-4b14-a4ee-c27602b74ed7 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:57.182575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5504cf-3b98-4d3f-9ef1-b27e795650a0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:57.212764 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:57.213635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:57.213910 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:57.214220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:57.218653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:57.219276 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:57.219554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:57.219823 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:57.221000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:57.222455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.224068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:31:57 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:31:57.230159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:57.246494 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:57.340346 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc811951-41f0-4cbb-ae67-9745cc00af79 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:57.346554 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:57.348051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:31:57.367158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:31:57.368235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:31:57.369330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:31:57.369330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:31:57.369330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:31:57.369330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:31:57.374100 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:57.377498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:57.378130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:57.378409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:57.378679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:57.379804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:57.381301 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.382889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:31:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:31:57.388959 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:31:57.427640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:57.468883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:31:57.476431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fdd05-5c27-47d5-b15e-276f07f7e7fb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:57.488513 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ec24c-24fb-4403-ba8e-02496b883511 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:31:57.510023 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:57.510643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:57.510922 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:57.511199 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:57.511850 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:31:57.512154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:57.513946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20c5e4-5119-47be-ad62-2cb6e6ec6896 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.522770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:31:57.523384 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:31:57.523659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:31:57.523974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:31:57.524644 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.domain.id=default, user.id=34c7ada225bf4c9f83deb9a393935185) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:31:57.524987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:31:57.526439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82f9d-ae02-4d1a-8353-900c1859c730 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:31:57.531482 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:31:57.533832 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Sep 3 20:31:57 2022] GET /identity/v3/role_assignments?user.id=34c7ada225bf4c9f83deb9a393935185&scope.domain.id=default&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:00.079447 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad26fc-bfe1-4a5a-8435-3276d433b663 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.080004 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad26fc-bfe1-4a5a-8435-3276d433b663 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.080004 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad26fc-bfe1-4a5a-8435-3276d433b663 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.081384 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:00.087212 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee8084-98a0-4cb9-bf15-39ebeb62b280 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.087685 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee8084-98a0-4cb9-bf15-39ebeb62b280 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.087760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee8084-98a0-4cb9-bf15-39ebeb62b280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.117968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-5dee8084-98a0-4cb9-bf15-39ebeb62b280 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:00.119204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-5dee8084-98a0-4cb9-bf15-39ebeb62b280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:00.170069 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cecd35-1354-4245-9d8d-9931ef759155 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.170696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cecd35-1354-4245-9d8d-9931ef759155 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.171167 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cecd35-1354-4245-9d8d-9931ef759155 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.172731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 12/23] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:00.198917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd221-a151-4d3b-9b72-1d73c86a7030 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.199626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd221-a151-4d3b-9b72-1d73c86a7030 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.200111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cd221-a151-4d3b-9b72-1d73c86a7030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.234720 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:00.242090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-638cd221-a151-4d3b-9b72-1d73c86a7030 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:00.243573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-638cd221-a151-4d3b-9b72-1d73c86a7030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:00.341254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:00.707869 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfabe-904a-4482-ae6c-1bb3c423e582 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.708214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfabe-904a-4482-ae6c-1bb3c423e582 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.708328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfabe-904a-4482-ae6c-1bb3c423e582 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.709747 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 13/26] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:00.715052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.715608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.723972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f2ef-30c9-485c-828c-babab4fd0921 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.724251 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f2ef-30c9-485c-828c-babab4fd0921 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.724522 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114f2ef-30c9-485c-828c-babab4fd0921 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.725940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:00.732114 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:00.732388 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:00.732656 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:00.758657 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:00.759853 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:00.766178 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:00.767316 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:00.834051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:00.890341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:00.891765 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:00.906570 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:00.907230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:00.917159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:01.065335 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d3206-b92e-4487-9161-8586b78fc5fa None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.109756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.110422 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.110661 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.110894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.111567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:01.112992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:01.118860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af10aec-a022-4cc5-9217-364aab3fe5d0 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.178580 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.179226 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.179501 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.179899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.201592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:01.208026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:01.208917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:01.209788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:01.215743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:01.216576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:01.277209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:01.280268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 3 20:32:00 2022] POST /identity/v3/roles => generated 219 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:01.406851 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c983e-6bc5-4cc5-9a0f-8b8beeacc58e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.461433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.462061 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.462337 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.462607 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.463301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:01.463601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:01.465076 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:01.477489 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:01.492814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:01.500807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:01.589950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:01.654055 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c150c-23c9-4c14-ad3a-007c2e3d799d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.673266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:01.682333 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdc897-1b3a-4c5c-8d7b-12fcb6bfe7b4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.702991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.703658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.703934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.704207 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.716923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:01.719603 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:01.729608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.730261 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.730538 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.730808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.732304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:01.733791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:01.735394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:01 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:01.736269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:32:01.739064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:01.739915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:32:01.740709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:32:01.740709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:32:01.740709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:01.743158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 17/34] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:01.744144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:01.860481 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc736a7-acc0-440e-93ea-5fba1f0c6b79 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.867451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0417ca-5a66-40c5-8a1e-4de468df8758 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:01.883910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:01.897237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeab387-83bb-44d1-8a7e-5ec2eb0ac288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.897964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab387-83bb-44d1-8a7e-5ec2eb0ac288 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.898239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab387-83bb-44d1-8a7e-5ec2eb0ac288 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.898507 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab387-83bb-44d1-8a7e-5ec2eb0ac288 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.899177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeab387-83bb-44d1-8a7e-5ec2eb0ac288 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:01.900555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeab387-83bb-44d1-8a7e-5ec2eb0ac288 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:01.902426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:01.903064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:01.903339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:01.903608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:01.904710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:01.906179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:01.907767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 18/35] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:01.908526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:02.009646 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876b6d4-c26e-4152-87b6-85a38db85ce8 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:02.026421 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 18/36] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 3 20:32:01 2022] POST /identity/v3/roles => generated 225 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:02.028153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f71f-7cae-4e44-91be-9b014769de4f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.028444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f71f-7cae-4e44-91be-9b014769de4f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.028722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939f71f-7cae-4e44-91be-9b014769de4f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.030172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 19/37] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:02.031073 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd979d-eccd-43f5-b871-0dcda9a5a620 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.031412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd979d-eccd-43f5-b871-0dcda9a5a620 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.031691 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd979d-eccd-43f5-b871-0dcda9a5a620 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.032957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 20/38] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:02.033694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd979d-eccd-43f5-b871-0dcda9a5a620 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:02.060746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:02.061417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.061694 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.061962 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.062621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:02.062918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:02.064394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61006e2-34d2-43de-8692-bce213d0334f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:02.067762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:02.085243 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 19/39] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:02.086769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489795b6-fae8-4cf1-b33b-1a57379b5755 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.087056 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489795b6-fae8-4cf1-b33b-1a57379b5755 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.087325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489795b6-fae8-4cf1-b33b-1a57379b5755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.109066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-489795b6-fae8-4cf1-b33b-1a57379b5755 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:02.110699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-489795b6-fae8-4cf1-b33b-1a57379b5755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:02.161802 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:02.176804 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd979d-eccd-43f5-b871-0dcda9a5a620 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:02.193296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:02.201497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.201497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.201497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.215183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:02.216408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:02.225862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:02.226590 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.226873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.227161 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] PATH_INFO: `/v3/domains/default/users/34c7ada225bf4c9f83deb9a393935185/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.229346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=34c7ada225bf4c9f83deb9a393935185, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:02.230916 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:02.252528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1361 bytes} [Sat Sep 3 20:32:02 2022] PUT /identity/v3/domains/default/users/34c7ada225bf4c9f83deb9a393935185/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:32:02.253248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:02.320931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:02.377960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:02.406636 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e670b-2e7a-4297-8b5b-70719e17adb9 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:02.452988 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:02.453702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.453985 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.454318 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.455023 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:02.456494 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:02.489818 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 22/43] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:32:02 2022] POST /identity/v3/projects => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:02.544759 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:02.666466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502849d-3851-4d72-b707-9f3a83bbe9e7 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:02.669273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:02.705018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:02.705642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.705920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.706190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.706860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:02.708282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:02.726691 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:02.727944 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 3 20:32:02 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:02.859028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7b354-8afa-4f6b-97dc-4a12b0e3fdb9 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:02.900555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8c520-201e-4498-a382-f5dce3945c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:02.901249 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8c520-201e-4498-a382-f5dce3945c36 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:02.901531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8c520-201e-4498-a382-f5dce3945c36 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:02.901803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8c520-201e-4498-a382-f5dce3945c36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:02.902947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8c520-201e-4498-a382-f5dce3945c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:02.904426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8c520-201e-4498-a382-f5dce3945c36 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:02.906216 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:02.911966 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:03.021557 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44e6cb-eff6-4f23-9c6a-a7a7ce5f6018 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:03.058999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2868ae6-302f-4dc6-82dd-8bf51b83cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:03.059611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868ae6-302f-4dc6-82dd-8bf51b83cc6c None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:03.059905 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868ae6-302f-4dc6-82dd-8bf51b83cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:03.060175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2868ae6-302f-4dc6-82dd-8bf51b83cc6c None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:03.060817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2868ae6-302f-4dc6-82dd-8bf51b83cc6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:03.062348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2868ae6-302f-4dc6-82dd-8bf51b83cc6c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:03.093289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:32:02 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:04.511555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b2994-c20d-4a43-91ec-78beb55799b4 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:04.512053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b2994-c20d-4a43-91ec-78beb55799b4 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:04.512053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b2994-c20d-4a43-91ec-78beb55799b4 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:04.513434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:04.519147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:04.519580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:04.519680 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:04.538345 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:04.539499 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:04.550203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:04.610290 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:04.933776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b2994-c20d-4a43-91ec-78beb55799b4 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:04.936876 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:05.038644 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b2994-c20d-4a43-91ec-78beb55799b4 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:05.072535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:05.073194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.073471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.073736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.083860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:05.089221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:05.090099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:05.090858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:05.096514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:05.209160 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667d99e-8030-43f1-8bc3-38273b37bf04 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:05.245960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:05.246574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.246846 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.247110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.247769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:05.248065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:05.249506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deec28c-0f7f-4f41-9e79-2cf36124d6b2 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:05.258157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 25/50] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:05.264582 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:05.308359 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca0ef-7fb1-4da5-bf7e-7299ef931fef None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.308664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca0ef-7fb1-4da5-bf7e-7299ef931fef None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.308975 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bca0ef-7fb1-4da5-bf7e-7299ef931fef None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.310328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 26/51] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:05.315193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.315479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.315755 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.327895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:05.334021 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:05.335254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:05.337331 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:05.369680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fffd4a-ff10-4341-ba19-ba11eaf7b058 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:05.405106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:05.405753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.406033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.406306 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.407451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:05.408955 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:05.409045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:05.410523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:05 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:05.418548 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:05.519418 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336fafc-ebc5-4bad-866c-b0a04cc96d48 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:05.552954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:05.553658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.553930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.554197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.555313 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:05.556755 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:05.558349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 28/54] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:05.564378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:05.666103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405771e2-5004-48c9-8cbc-39f3e2a31d26 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:05.694062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:05.700997 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:05.701610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.701896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.702168 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.702887 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.domain.id=default, user.id=34c7ada225bf4c9f83deb9a393935185) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:05.703193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:05.704646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:05.712727 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Sep 3 20:32:05 2022] GET /identity/v3/role_assignments?user.id=34c7ada225bf4c9f83deb9a393935185&scope.domain.id=default&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:05.742201 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:05.752164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:05.858776 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0a08f-b8f8-4249-b362-87bfa87ff15f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:05.895265 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb8af8-ccf8-4652-b0db-ed5b87a11eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:05.895874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb8af8-ccf8-4652-b0db-ed5b87a11eb8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:05.896150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb8af8-ccf8-4652-b0db-ed5b87a11eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:05.896417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb8af8-ccf8-4652-b0db-ed5b87a11eb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:05.897587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb8af8-ccf8-4652-b0db-ed5b87a11eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:05.899033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb8af8-ccf8-4652-b0db-ed5b87a11eb8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:05.900641 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 29/56] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:05.906658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:06.019847 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18cd30-8004-4995-a669-c2d0fd185c7c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:06.057404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88163298-31d1-42a9-89cb-6e48b43df939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:06.058025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88163298-31d1-42a9-89cb-6e48b43df939 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:06.058305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88163298-31d1-42a9-89cb-6e48b43df939 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:06.058580 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88163298-31d1-42a9-89cb-6e48b43df939 None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:06.059232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88163298-31d1-42a9-89cb-6e48b43df939 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:06.060708 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88163298-31d1-42a9-89cb-6e48b43df939 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:06.093142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 28/57] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Sep 3 20:32:05 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:08.263029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b71fc-0d9b-47c5-ab64-4063034b1a4c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:08.264271 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b71fc-0d9b-47c5-ab64-4063034b1a4c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:08.264271 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b71fc-0d9b-47c5-ab64-4063034b1a4c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:08.266426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 30/58] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:08.275191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:08.275620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:08.275763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:08.299635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:08.301242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:08.346975 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:08.374041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:08.697743 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b71fc-0d9b-47c5-ab64-4063034b1a4c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:08.786373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:08.815479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b71fc-0d9b-47c5-ab64-4063034b1a4c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:08.858947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3be9-863e-49fb-8efc-3214b51677cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:08.859576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3be9-863e-49fb-8efc-3214b51677cc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:08.859854 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3be9-863e-49fb-8efc-3214b51677cc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:08.860122 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3be9-863e-49fb-8efc-3214b51677cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:08.861315 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3be9-863e-49fb-8efc-3214b51677cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:08.862795 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3be9-863e-49fb-8efc-3214b51677cc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:08.864353 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 31/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:08.873821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:08.989009 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a468f2-3f19-41ff-b786-5cbf24d6ee48 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:09.025064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87552b-9073-49cf-8f43-379f1a08dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:09.025667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87552b-9073-49cf-8f43-379f1a08dbc7 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:09.025944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87552b-9073-49cf-8f43-379f1a08dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:09.026212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87552b-9073-49cf-8f43-379f1a08dbc7 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:09.026857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87552b-9073-49cf-8f43-379f1a08dbc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:09.028315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87552b-9073-49cf-8f43-379f1a08dbc7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:09.060224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 30/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:08 2022] POST /identity/v3/users => generated 275 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:12.394076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5b99-881e-4e0b-a853-c462413264f7 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.395088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5b99-881e-4e0b-a853-c462413264f7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.395561 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5b99-881e-4e0b-a853-c462413264f7 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.397352 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 32/62] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:12.402831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45ca4-c2b8-4e43-a52a-1a451c8dadbd None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.403683 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45ca4-c2b8-4e43-a52a-1a451c8dadbd None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.404145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45ca4-c2b8-4e43-a52a-1a451c8dadbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.430086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-32f45ca4-c2b8-4e43-a52a-1a451c8dadbd None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:12.431338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-32f45ca4-c2b8-4e43-a52a-1a451c8dadbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:12.463397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:12.526451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 31/63] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:12.778610 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210fa9-2ef8-4ecc-a780-76191c8e010d None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.779298 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210fa9-2ef8-4ecc-a780-76191c8e010d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.779770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210fa9-2ef8-4ecc-a780-76191c8e010d None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.781409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 33/64] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:12.786633 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9471f-37f2-4ff1-9f68-84b4ee4a5790 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.787131 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9471f-37f2-4ff1-9f68-84b4ee4a5790 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.787595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9471f-37f2-4ff1-9f68-84b4ee4a5790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.813831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-c3c9471f-37f2-4ff1-9f68-84b4ee4a5790 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:12.815347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-c3c9471f-37f2-4ff1-9f68-84b4ee4a5790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:12.877177 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571d14e-5e1d-4d49-8639-bf304b79b0f9 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.877750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571d14e-5e1d-4d49-8639-bf304b79b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.878238 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571d14e-5e1d-4d49-8639-bf304b79b0f9 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.880007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 34/65] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:12.881326 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf6138-db47-40a0-a3f5-9520effdfa80 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.881967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf6138-db47-40a0-a3f5-9520effdfa80 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.882338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf6138-db47-40a0-a3f5-9520effdfa80 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.883843 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 35/66] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:12.890101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0b9c9-ff81-4aa0-bdd3-43288c95bb9d None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.890496 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0b9c9-ff81-4aa0-bdd3-43288c95bb9d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.890865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0b9c9-ff81-4aa0-bdd3-43288c95bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.899198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:12.901695 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:12.902133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:12.902554 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:12.917621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-56a0b9c9-ff81-4aa0-bdd3-43288c95bb9d None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:12.918807 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-56a0b9c9-ff81-4aa0-bdd3-43288c95bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:12.933600 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:12.938787 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:13.035616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 33/68] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:13.036476 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.048432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:13.062580 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.133672 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acf5e-123b-4b08-b18a-f0008bcda9e8 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.134052 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acf5e-123b-4b08-b18a-f0008bcda9e8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.134332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414acf5e-123b-4b08-b18a-f0008bcda9e8 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.135782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 37/70] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:13.141298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bde86-2c88-460a-a073-d5904f5c9fd3 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.146182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.146463 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.146733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.176822 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.177502 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.177784 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.178062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.179796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:13.181210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:13.188951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:13.194021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:13.195164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:13.195949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 34/71] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:13.201147 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.286308 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.305601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fcf7-a924-49d7-9a6b-5642db2b603f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.309782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 38/72] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:13.310850 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.313338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.343106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.343829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.344117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.344395 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.345099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:13.345402 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:13.347003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:13.356504 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 35/73] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:13.362302 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.420471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d834f-8e0c-4552-8ba2-cb033b848fd8 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.482428 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.484116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.486050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.486544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.498505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:13.503761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:13.504862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:13.505902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 39/74] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:13.506970 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.512954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe4f8c-79c9-4b53-8224-9c2843fb6060 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.550390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.550950 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.551231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.551509 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.567082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:13.568568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:13.574883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 36/75] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:13.574883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.574883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.584803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.626385 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d965c5-4836-4f56-9542-5a4329a408f6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.663821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.664763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.665209 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.665620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.676108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1e74f-fbcf-4b1f-a692-b9e4dfa91b97 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.677030 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:13.681903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:13.682777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 40/76] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:13.685598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.713929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.714577 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.714857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.715132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.725711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:13.730557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:13.731415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:13.732182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 37/77] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:13.732797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.788304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd434c3-9ddb-463c-9a7d-33c4df0f8f4c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.797108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.811070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:13.823952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.824575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.824889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.825187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.825860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:13.826161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:13.827576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:13.836159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 41/78] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:13.836772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ddd28-d8e4-444f-a6ac-732ab8236295 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.837729 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:13.873451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.874062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.874341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.874610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.944633 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e555ea-8cfc-460f-b850-155d239ae1ae None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:13.950012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:13.951513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:13.981319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:13.981967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:13.982235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:13.982511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:13.983680 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:13.985162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:13.986759 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 42/79] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:13.987523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.011751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.040406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.052268 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:14.053974 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.088601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d78e05-5c7f-426a-88a6-17001bb86d9e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.122554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.123157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.123445 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.123735 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.124393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:14.124701 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.126161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.140425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 43/81] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.140425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.155890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de06036-fcaf-4a0c-a894-308cc2d143af None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.189330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.190802 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.190802 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.190802 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.191163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:14.191466 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.192878 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.201491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 39/82] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.202278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.226935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.242971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcefb5-5f30-4121-92bb-a8c804a746be None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.256872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.277305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.277965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.278242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.278514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.279637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.281129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.282715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 44/83] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.283468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.305134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d28eda-798b-4230-9be2-069a1fefcbbb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.339886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.340506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.340787 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.341088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.341739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.343211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.365405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 40/84] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:14 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:14.377239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.380168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a5e3e-eb1d-48f2-9734-1a4439c9f526 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.421553 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.422220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.422491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.422767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.424689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.426814 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.429088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 45/85] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.434295 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.470980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.490639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.494403 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c09ce-c0ec-4949-bcac-4f62d07b476b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.535076 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.535739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.536017 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.536284 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.537521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.539119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.540956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 41/86] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.541606 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.561182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78571-3694-4192-9f4e-5cac52c96ba8 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.601171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.602177 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.602462 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.602734 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.605543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.607007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.609765 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 46/87] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.615117 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.665860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4c241-dfe7-4c02-8d18-191572cc4f0a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.711919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.712550 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.712859 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.713134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.733213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.752435 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794c610-4fc0-440e-b7e0-7b0260971d7e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.771112 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.790572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.791194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.791472 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.791741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:14.792471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=2e6691a25aef4167ab313743eb7500d4) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:14.792828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.794369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.800093 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 47/88] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/role_assignments?user.id=2e6691a25aef4167ab313743eb7500d4&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:14.801084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.805614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:14.807144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:14.922914 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 42/89] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:14.923766 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:14.938389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f516d-2030-4a89-9142-d4d643cb3752 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:14.976261 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:14.977337 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:14.977815 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:14.978047 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:14.978869 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.035523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef2b0-8112-45a1-ac6a-327fbadf4e73 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.040257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:15.062334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.064216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.074464 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.075103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.075546 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.075818 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.164751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.164751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.200299 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 48/90] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:15.200944 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:15.226210 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:15.321888 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 43/91] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:15.322749 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:15.345110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:15.375503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce212c-8729-4956-b687-3814286a86ab None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.439493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.440161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.440406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.440655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.442807 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.444487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.446665 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 49/92] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:15 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:15.447445 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:15.497567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38507216-b1b0-4af1-9380-22ad8f5e7858 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.559588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.560331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.560563 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.560761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] PATH_INFO: `/v3/projects/e905f3702e8d4bfa91686f1495f918a2` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.562187 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] RBAC: Authorizing `identity:get_project(project_id=e905f3702e8d4bfa91686f1495f918a2)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.563652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.565618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 44/93] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:15 2022] GET /identity/v3/projects/e905f3702e8d4bfa91686f1495f918a2 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:15.566380 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:15.601666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:15.628087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339824c-c407-4215-b54c-aff12c88f67f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.694960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.695626 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.695906 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.696179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.697382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.698843 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.700664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 50/94] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:15 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:15.701290 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:15.731309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26074bbc-31f0-4ad8-85d3-8657e1cb1cbf None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.742158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:15.776951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.776951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.776951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.776951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.777338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] RBAC: Adding query filter params (role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=2e6691a25aef4167ab313743eb7500d4) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:15.777338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.777338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.781549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 45/95] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:15 2022] GET /identity/v3/role_assignments?user.id=2e6691a25aef4167ab313743eb7500d4&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:15.782210 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:15.880860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:15.899043 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6777989-52bc-42b7-a120-f534405df648 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.937696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.938331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.938731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.938892 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.939601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=34c7ada225bf4c9f83deb9a393935185) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:15.939903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.941385 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc7a71-7dc9-489d-beeb-e87cdf394d88 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.943171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdde3a6-4f66-4b3d-b8c1-8e59964da4c2 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:15.948057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 46/96] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:15 2022] GET /identity/v3/role_assignments?user.id=34c7ada225bf4c9f83deb9a393935185&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:15.981626 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:15.982262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:15.982538 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:15.982811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:15.983567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=e905f3702e8d4bfa91686f1495f918a2, user.id=2e6691a25aef4167ab313743eb7500d4) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:15.983938 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:15.985598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8757c6-4baf-40a9-bcdc-3b64845e556a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:15.992860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 51/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:15 2022] GET /identity/v3/role_assignments?user.id=2e6691a25aef4167ab313743eb7500d4&scope.project.id=e905f3702e8d4bfa91686f1495f918a2&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:17.247937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0d2c-519e-4f92-9492-40b6ff98047b None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:17.249008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0d2c-519e-4f92-9492-40b6ff98047b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:17.249516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b0d2c-519e-4f92-9492-40b6ff98047b None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:17.251156 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 47/98] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:17.257315 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8422d97-e5d1-44c4-90f9-04097c7066f2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:17.258307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8422d97-e5d1-44c4-90f9-04097c7066f2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:17.258770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8422d97-e5d1-44c4-90f9-04097c7066f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:17.278472 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-f8422d97-e5d1-44c4-90f9-04097c7066f2 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:17.280040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-f8422d97-e5d1-44c4-90f9-04097c7066f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:17.355406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 52/99] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:17.537246 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91900-b7b2-4796-910c-ad1711ccc1e6 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:17.537886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91900-b7b2-4796-910c-ad1711ccc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:17.538371 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91900-b7b2-4796-910c-ad1711ccc1e6 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:17.540174 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 48/100] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:17.545544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efdbf8-c1af-4fc4-af72-8e6368b6e49f None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:17.546074 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efdbf8-c1af-4fc4-af72-8e6368b6e49f None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:17.546533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efdbf8-c1af-4fc4-af72-8e6368b6e49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:17.571711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-68efdbf8-c1af-4fc4-af72-8e6368b6e49f None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:17.573358 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-68efdbf8-c1af-4fc4-af72-8e6368b6e49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:17.587047 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:17.661909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 53/101] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:17.883066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1fe38-4abe-4b7e-9098-5a0392d5d734 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:17.883447 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1fe38-4abe-4b7e-9098-5a0392d5d734 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:17.883661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1fe38-4abe-4b7e-9098-5a0392d5d734 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:17.885178 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 49/102] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:17.890686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:17.890977 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:17.891257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:17.894370 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1fe38-4abe-4b7e-9098-5a0392d5d734 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:17.933971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:17.935174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:18.078744 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 54/103] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:18.080452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1fe38-4abe-4b7e-9098-5a0392d5d734 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:18.145194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:18.145900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:18.146190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:18.146470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:18.152554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:18.173902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:18.178942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:18.179772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:18.180514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:18.184900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 50/104] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:18.189791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:18.197172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:18.289215 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:18.324533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e329c7-2b1f-4454-a5cc-7d37b9bed441 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:18.387453 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:18.388114 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:18.388396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:18.388669 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:18.393510 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:18.394990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:18.396954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 55/105] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:18.402763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:18.437918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f321eea5-a10b-48a0-98bd-9028b9dac3fb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:18.496626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:18.497307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:18.497589 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:18.497860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:18.498540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:18.498957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:18.500479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:18.513777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 51/106] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:18.520205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:18.575182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047152d-ed77-458d-a2be-2b3c2d4e6ae0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:18.632449 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:18.639780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:18.640431 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:18.640788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:18.641354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:18.641866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:18.643329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:18.665187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:18.693473 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 56/107] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:32:18 2022] POST /identity/v3/projects => generated 302 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:32:18.695548 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:18.700533 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c93db9-5f2e-4d13-8044-6700d69c5999 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:18.770595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:18.771251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:18.771531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:18.771809 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] PATH_INFO: `/v3/users/0d1c9a352dd44a27a6a2be16a77b67e8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:18.798542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] RBAC: Authorizing `identity:get_user(user_id=0d1c9a352dd44a27a6a2be16a77b67e8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:18.800108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:18.803057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 52/108] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:18 2022] GET /identity/v3/users/0d1c9a352dd44a27a6a2be16a77b67e8 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:18.809031 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:18.924641 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5edaf4-51e5-4eaa-927e-09d8e0987d56 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:18.997780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:18.999566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:18.999859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.000135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.021303 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254e6f1-1b0f-46ef-9f3f-48234c684a37 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.024242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:19.030645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:19.031630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:19.032394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 57/109] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:19.043103 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:19.072013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:19.101639 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63604469-8d9f-4407-a9b9-7cdfae7eda52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.102218 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604469-8d9f-4407-a9b9-7cdfae7eda52 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.102683 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604469-8d9f-4407-a9b9-7cdfae7eda52 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.102949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63604469-8d9f-4407-a9b9-7cdfae7eda52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.112694 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:19.167537 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e475d9-f84d-4b1d-99ae-dad17a7274b9 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.184358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63604469-8d9f-4407-a9b9-7cdfae7eda52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.185799 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63604469-8d9f-4407-a9b9-7cdfae7eda52 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.203838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.204564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.204866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.205150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.205825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:19.206184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.207794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ce70f-f7b1-45ca-9a75-d4d969afb162 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.216496 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 58/110] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:19.222118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f21658-24d5-4033-b0ef-9aaf70747dd7 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.222512 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f21658-24d5-4033-b0ef-9aaf70747dd7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.222797 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f21658-24d5-4033-b0ef-9aaf70747dd7 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.224057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 59/111] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:19.225646 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f21658-24d5-4033-b0ef-9aaf70747dd7 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:19.346651 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f21658-24d5-4033-b0ef-9aaf70747dd7 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.361509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:19.380872 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 53/112] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:32:19.382620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.383082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.383523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.384215 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.384982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.385339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.385684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.392859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.392859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.395206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 60/113] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:19 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:19.396052 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:19.421527 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:19.423198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:19.461240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:19.505068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1570f-35c8-453e-9b3f-c890749becb1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.520385 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 54/114] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:19.528860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:19.549595 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2360c-7e93-494d-9bbf-c44ccd00e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.550586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2360c-7e93-494d-9bbf-c44ccd00e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.551142 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2360c-7e93-494d-9bbf-c44ccd00e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.551625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2360c-7e93-494d-9bbf-c44ccd00e7a4 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.553029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2360c-7e93-494d-9bbf-c44ccd00e7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.555035 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2360c-7e93-494d-9bbf-c44ccd00e7a4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.556955 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 61/115] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:19 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:19.558272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8b84-950c-4a8f-a3c7-800fc02d75e4 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.558848 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8b84-950c-4a8f-a3c7-800fc02d75e4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.559407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8b84-950c-4a8f-a3c7-800fc02d75e4 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.560780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 62/116] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:19.562216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94833a-6451-4f3e-b230-17d6053921dc None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.562693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94833a-6451-4f3e-b230-17d6053921dc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.563172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94833a-6451-4f3e-b230-17d6053921dc None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.565106 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 63/117] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:19.566048 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94833a-6451-4f3e-b230-17d6053921dc None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:19.620614 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:19.634803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7c56e-be31-4b35-8b19-b4ecbe41ba01 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.675477 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b3063-ee0b-48cf-8c41-7c8e96fb4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.676172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b3063-ee0b-48cf-8c41-7c8e96fb4d66 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.676453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b3063-ee0b-48cf-8c41-7c8e96fb4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.676777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b3063-ee0b-48cf-8c41-7c8e96fb4d66 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.677589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94833a-6451-4f3e-b230-17d6053921dc None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.677989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b3063-ee0b-48cf-8c41-7c8e96fb4d66 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.679601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b3063-ee0b-48cf-8c41-7c8e96fb4d66 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.681456 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 55/118] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:19 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:19.687790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.688005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.688247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.708383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:19.709894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:19.714285 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.715132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.715618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.716076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.717025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] RBAC: Adding query filter params (role.id=535025a1e39c4dd983e47ecbf0dbfe92, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=0d1c9a352dd44a27a6a2be16a77b67e8) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:19.717540 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.719248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120d1d-d4c9-4077-8036-8e722faebcc1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.725882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 64/119] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:19 2022] GET /identity/v3/role_assignments?user.id=0d1c9a352dd44a27a6a2be16a77b67e8&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=535025a1e39c4dd983e47ecbf0dbfe92 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:19.727333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.727810 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.728268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.728982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:19.750641 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:19.752371 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:19.789603 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 56/120] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:19.790329 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:19.827784 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 65/121] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:19.899344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92927f-fa2b-4732-a3b1-43effd6893ad None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:19.937662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:19.938357 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:19.938640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:19.938917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/2e6691a25aef4167ab313743eb7500d4/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:19.940968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] RBAC: Authorizing `identity:create_grant(project_id=95075c2c580f4f1894bbaa9d34591719, user_id=2e6691a25aef4167ab313743eb7500d4, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:19.942454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:19.968795 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 57/122] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:19 2022] PUT /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/2e6691a25aef4167ab313743eb7500d4/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:32:20.055739 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.114411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:20.207926 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ab429-d973-4d93-8f43-b422a3ff25de None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:20.235544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.251646 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:20.252302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:20.252587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:20.252925 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:20.262719 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:20.271049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:20.280197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:20.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:20.281918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:20.284223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 66/123] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:20.290692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.431441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51336a-19cd-4321-8349-b6b6cedad46f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:20.478987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da916bc-8060-47ef-b4e3-2a3005991202 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:20.481902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:20.489029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:20.489671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:20.489884 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:20.490161 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:20.503660 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:20.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:20.510052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:20.510837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 58/124] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:20.516707 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.521504 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:20.522541 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:20.523033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:20.523490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:20.524346 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:20.524867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:20.526460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:20.535307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 67/125] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:20.541185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.624106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:20.680401 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259fd76-3078-4f57-8e9f-10f8df5bf4c4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:20.722022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a87de-88d1-40df-9598-5a2355fa2392 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:20.761324 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:20.761932 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:20.762223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:20.762502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:20.763656 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:20.765617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:20.767571 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 68/126] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:20.768503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.773648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487464da-4548-4235-b469-6131eccd362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:20.774287 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487464da-4548-4235-b469-6131eccd362f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:20.774571 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487464da-4548-4235-b469-6131eccd362f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:20.774848 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487464da-4548-4235-b469-6131eccd362f None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:20.775531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487464da-4548-4235-b469-6131eccd362f None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:20.775838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487464da-4548-4235-b469-6131eccd362f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:20.777282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487464da-4548-4235-b469-6131eccd362f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:20.795846 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 59/127] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:20.796703 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487464da-4548-4235-b469-6131eccd362f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:20.837182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:20.965369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779d2ec-761f-4b11-9f54-9faada963dd9 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:20.983378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487464da-4548-4235-b469-6131eccd362f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.026251 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.027037 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.028485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.028763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.046011 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.046658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.046933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.047199 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.048188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:21.049442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.050928 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.055925 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 60/128] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:21.056745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:21.059798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:21.060634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:21.061432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:21.062964 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 69/129] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:21.063388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:21.066324 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.245202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:21.251998 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a45df8-c366-44da-8404-bcff26c6d4b1 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.255627 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff77a4b-d9c8-4ed3-ad07-a848707f81b4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.314323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.315977 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.316802 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.317810 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.318575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.318852 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.319188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/2e6691a25aef4167ab313743eb7500d4/roles/0c3434548fa045d9a248a23fd0a93fa4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.319344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.321026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.323059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.327059 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] RBAC: Authorizing `identity:create_grant(project_id=95075c2c580f4f1894bbaa9d34591719, user_id=2e6691a25aef4167ab313743eb7500d4, role_id=0c3434548fa045d9a248a23fd0a93fa4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.328321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 61/130] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:21 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:21.329173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.330041 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.358677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 70/131] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:21 2022] PUT /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/2e6691a25aef4167ab313743eb7500d4/roles/0c3434548fa045d9a248a23fd0a93fa4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:32:21.359936 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.504051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67258ec-0be4-460d-8d99-6156dcd3c201 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.531502 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:21.599080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5db80a-0126-4aed-bf0b-a07249993136 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.614136 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.614799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.615078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.615349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] PATH_INFO: `/v3/projects/e905f3702e8d4bfa91686f1495f918a2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.620999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] RBAC: Authorizing `identity:get_project(project_id=e905f3702e8d4bfa91686f1495f918a2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.620999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.620999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 71/132] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:21 2022] GET /identity/v3/projects/e905f3702e8d4bfa91686f1495f918a2 => generated 312 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:21.628856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.660078 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.661039 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.661566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.662003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.663192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:21.663881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.665646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.679441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 62/133] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:21.689107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.690597 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:21.809345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8992fd4-e2af-46ee-896c-d4e134677362 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.814628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ebe3-04b0-41c3-8de3-4d63c11fc554 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.848007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:21.855226 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.855792 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.856084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.856518 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.857751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.859224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.861007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 63/134] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:21 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:21.866798 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:21.873769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b576752-109b-42da-92ee-d181c48610e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:21.874465 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576752-109b-42da-92ee-d181c48610e1 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.874744 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576752-109b-42da-92ee-d181c48610e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.875019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b576752-109b-42da-92ee-d181c48610e1 None admin] PATH_INFO: `/v3/projects/e905f3702e8d4bfa91686f1495f918a2/users/2e6691a25aef4167ab313743eb7500d4/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.878162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b576752-109b-42da-92ee-d181c48610e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e905f3702e8d4bfa91686f1495f918a2, user_id=2e6691a25aef4167ab313743eb7500d4, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:21.879625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b576752-109b-42da-92ee-d181c48610e1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:21.927329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 72/135] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:21 2022] PUT /identity/v3/projects/e905f3702e8d4bfa91686f1495f918a2/users/2e6691a25aef4167ab313743eb7500d4/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:21.928428 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb6ff-c472-421d-a331-df70e35726fb None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.928721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb6ff-c472-421d-a331-df70e35726fb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.929014 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb6ff-c472-421d-a331-df70e35726fb None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.930272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 73/136] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:21.935909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:21.936225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:21.936450 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:21.985427 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8cfa5-2b47-4b56-91e7-94ace3ef8364 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:21.985854 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:21.987273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:22.024610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:22.025307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:22.025588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:22.025863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:22.027108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:22.028636 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:22.030678 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 64/137] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:21 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:22.036620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:22.111779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:22.152157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db26ed-8ef5-4195-97a5-e74a18f6d0c7 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:22.179512 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 74/138] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:22.195523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafb8a6-0ddb-4b15-be76-c23c9c06cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:22.196496 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafb8a6-0ddb-4b15-be76-c23c9c06cd5e None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:22.197025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafb8a6-0ddb-4b15-be76-c23c9c06cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:22.197458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafb8a6-0ddb-4b15-be76-c23c9c06cd5e None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/34c7ada225bf4c9f83deb9a393935185/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:22.199583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafb8a6-0ddb-4b15-be76-c23c9c06cd5e None admin] RBAC: Authorizing `identity:create_grant(project_id=95075c2c580f4f1894bbaa9d34591719, user_id=34c7ada225bf4c9f83deb9a393935185, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:22.201278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafb8a6-0ddb-4b15-be76-c23c9c06cd5e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:22.222306 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 65/139] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:22 2022] PUT /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/34c7ada225bf4c9f83deb9a393935185/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:32:22.614197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:22.629332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:22.640622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c01ce-8d97-4302-958a-ed4216f51a26 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:22.641208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c01ce-8d97-4302-958a-ed4216f51a26 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:22.641208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c01ce-8d97-4302-958a-ed4216f51a26 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:22.642755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 66/140] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:22.656262 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:22.656571 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:22.656811 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:22.687866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:22.689084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:22.769230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cb91a-0cb4-47f4-92ea-2cf082ce0b49 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:22.847785 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:22.848448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:22.848721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:22.849011 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] PATH_INFO: `/v3/domains/default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:22.850181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:22.851670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:22.851905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 67/141] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:22.856929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 75/142] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:22.861873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:22.960688 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:23.005724 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e41360-3676-4f8c-897c-7b7e341c3595 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:23.043061 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba14b47-b8c1-4608-9823-be962a72625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:23.044096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14b47-b8c1-4608-9823-be962a72625f None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:23.044585 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14b47-b8c1-4608-9823-be962a72625f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:23.045594 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba14b47-b8c1-4608-9823-be962a72625f None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:23.046812 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14b47-b8c1-4608-9823-be962a72625f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:23.048484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba14b47-b8c1-4608-9823-be962a72625f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:23.088142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 68/143] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:22 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:23.431806 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:23.443143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69914e8-b5ff-4797-9b97-6545dc391a1a None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:23.443143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69914e8-b5ff-4797-9b97-6545dc391a1a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:23.443143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69914e8-b5ff-4797-9b97-6545dc391a1a None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:23.443143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 69/144] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:23.449117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:23.449710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:23.450194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:23.475724 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:23.477544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:23.517043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:23.547849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c4bd9-fa43-414f-a317-18b20e0a37be None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:23.555292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 70/145] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:23.591895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:23.592536 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:23.592816 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:23.593117 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:23.608095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:23.612942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:23.613840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:23.615609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 76/146] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:23.620730 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:23.682904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:23.743666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb909454-cf14-4a74-9dc5-0309914ec0d3 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:23.783991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:23.785016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:23.785527 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:23.786000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:23.786863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:23.787358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:23.789258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:23.802710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 71/147] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:23.808065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:23.931456 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6d04-fdea-4741-b3c7-edb09acb472e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:23.973332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:23.974084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:23.974741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:23.975019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:23.975386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] PATH_INFO: `/v3/users/0d1c9a352dd44a27a6a2be16a77b67e8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:23.976564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=0d1c9a352dd44a27a6a2be16a77b67e8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:23.978044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:23.979816 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 77/148] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:23 2022] GET /identity/v3/users/0d1c9a352dd44a27a6a2be16a77b67e8 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:23.985057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:23.996610 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:24.114483 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ba174-a522-4989-aa88-f9ba50b3b7ea None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:24.133477 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:24.146405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbb0d8-31c9-46aa-bb03-151e70502aa5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:24.186154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:24.186822 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:24.187102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:24.187367 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:24.192718 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:24.193397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:24.193674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:24.193972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:24.195424 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:24.197046 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:24.199086 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 78/149] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:23 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:24.204796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:24.211260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:24.216628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:24.217528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:24.218279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:24.221923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 72/150] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:24.227957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:24.298094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:24.330625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f4cbe-2a74-4f5c-8dc2-e77eea2e6a05 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:24.372328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:24.373039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:24.373401 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:24.373677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/0d1c9a352dd44a27a6a2be16a77b67e8/roles/535025a1e39c4dd983e47ecbf0dbfe92` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:24.375818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] RBAC: Authorizing `identity:create_grant(project_id=95075c2c580f4f1894bbaa9d34591719, user_id=0d1c9a352dd44a27a6a2be16a77b67e8, role_id=535025a1e39c4dd983e47ecbf0dbfe92)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:24.376753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d7a57-9514-4012-a622-20e78edbf873 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:24.377324 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:24.401253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 79/151] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:24 2022] PUT /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719/users/0d1c9a352dd44a27a6a2be16a77b67e8/roles/535025a1e39c4dd983e47ecbf0dbfe92 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:32:24.432519 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:24.433176 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:24.433454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:24.433726 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:24.434406 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:24.434710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:24.436147 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:24.450866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 73/152] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:24.456699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:24.634622 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196b436-1e29-4451-a606-92d0d50d4088 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:24.690891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:24.691562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:24.691838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:24.692111 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:24.693382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:24.697140 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:24.699095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 80/153] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:24 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:24.704579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:24.750418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:24.837302 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d9811-877d-4fde-9440-f194a4c0660d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:24.880446 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:24.881136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:24.881414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:24.881749 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:24.955969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:24.957467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:24.992322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:25.072610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:25.078289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:25.086248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:25.228469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f33034-5872-4822-b1b4-47b509b96cfc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:25.270608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b501b-8d1d-4290-b073-0200fca89a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:25.271274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b501b-8d1d-4290-b073-0200fca89a81 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:25.271556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b501b-8d1d-4290-b073-0200fca89a81 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:25.271828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b501b-8d1d-4290-b073-0200fca89a81 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:25.273127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b501b-8d1d-4290-b073-0200fca89a81 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:25.274595 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b501b-8d1d-4290-b073-0200fca89a81 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:25.276280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 81/155] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:25 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:25.282330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:25.340572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27f9e-321d-4539-8559-14ca49ad5939 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:25.341056 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27f9e-321d-4539-8559-14ca49ad5939 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:25.341336 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec27f9e-321d-4539-8559-14ca49ad5939 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:25.342706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 82/156] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:25.354480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd437-78c6-44aa-be26-39cf8f391a1e None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:25.354811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd437-78c6-44aa-be26-39cf8f391a1e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:25.355019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedd437-78c6-44aa-be26-39cf8f391a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:25.382756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-aaedd437-78c6-44aa-be26-39cf8f391a1e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:25.383956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-aaedd437-78c6-44aa-be26-39cf8f391a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:25.405059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a5d1f-4aae-4905-84cb-ee5765e274fe None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:25.436535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:25.452074 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:25.452763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:25.453072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:25.453346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:25.454190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=2e6691a25aef4167ab313743eb7500d4) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:25.454497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:25.459096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384b2ba-e020-483c-a68a-93d489f703ca None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:25.466830 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 75/157] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:25 2022] GET /identity/v3/role_assignments?user.id=2e6691a25aef4167ab313743eb7500d4&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:25.491645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 83/158] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:25.944931 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243805-2dcf-4cee-b439-0d87f8485877 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:25.945681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243805-2dcf-4cee-b439-0d87f8485877 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:25.945681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7243805-2dcf-4cee-b439-0d87f8485877 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:25.946841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 76/159] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:25.952307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:25.952856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:25.952856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:25.959276 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:25.982889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:25.984643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:26.089071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 84/160] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:26.139652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243805-2dcf-4cee-b439-0d87f8485877 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:26.270733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7243805-2dcf-4cee-b439-0d87f8485877 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:26.314707 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510560a-0366-47dd-add1-d21b0b0b3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:26.315343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510560a-0366-47dd-add1-d21b0b0b3c4a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:26.315614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510560a-0366-47dd-add1-d21b0b0b3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:26.315882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510560a-0366-47dd-add1-d21b0b0b3c4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:26.329934 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6510560a-0366-47dd-add1-d21b0b0b3c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-6510560a-0366-47dd-add1-d21b0b0b3c4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:26.335229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:26.336206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:26.337041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 77/161] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:26.344733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:26.386702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053fdef-7669-4e90-b85f-a81bc1413018 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:26.387048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053fdef-7669-4e90-b85f-a81bc1413018 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:26.387239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053fdef-7669-4e90-b85f-a81bc1413018 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:26.388819 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 78/162] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:26.394219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:26.394498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:26.394763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:26.430109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:26.431307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:26.496135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23315c83-57b0-4c15-92dd-c074d2a17fe5 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:26.544775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:26.548767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:26.549421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:26.549703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:26.549974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:26.550653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:26.550954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:26.552370 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:26.567139 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 85/163] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:26.570116 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:26.573386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:26.591524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 79/164] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:26.648712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:26.759119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21fc31-f666-4342-a3bf-ee51a3a3ec80 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:26.810439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3978f8-bb9a-4f17-aa3f-8c85d21cc54d None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:26.821115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:26.821975 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:26.822441 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:26.822840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:26.824382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:26.825896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:26.827927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 86/165] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:26 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:26.833514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:26.870453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:26.871197 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:26.871562 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:26.871832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:26.890052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:26.895247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:26.896103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:26.897301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 80/166] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:26.903034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:26.926441 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:26.983884 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:26.985536 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f486e-5c3a-4795-bd7a-c0d29a28a747 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.046345 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:27.048790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:27.049691 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:27.049992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:27.072562 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94307d2-93bc-43d1-9781-09327dafbf68 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.149276 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:27.150165 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:27.150584 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:27.150994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:27.152027 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:27.153451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:27.155862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:27.173048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 81/167] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:27.178972 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:27.196781 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:27.198312 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:27.305990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:27.346501 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec06536-6901-4b9e-92ae-ad8dfc3f087c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.352121 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:27.373463 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 87/168] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:27.374919 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:27.434954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:27.436142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:27.437502 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:27.438702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:27.455961 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:27.464874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:27.465750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 82/169] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:27.466568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:27.558167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a064e-86d7-4fc4-abd5-b91b85f4a1e3 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.637172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baacbf8-6ba9-4c22-b996-123be16de263 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.649541 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:27.650205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:27.650478 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:27.650854 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] PATH_INFO: `/v3/users/2e6691a25aef4167ab313743eb7500d4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:27.651940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] RBAC: Authorizing `identity:get_user(user_id=2e6691a25aef4167ab313743eb7500d4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:27.653452 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:27.655133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 88/170] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:27 2022] GET /identity/v3/users/2e6691a25aef4167ab313743eb7500d4 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:27.655959 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:27.687970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:27.688625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:27.688929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:27.689208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:27.691164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:27.692669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:27.694859 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 83/171] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:27 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:27.695719 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:27.735049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:27.790691 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:27.911428 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c028112-5d51-4ee9-bdb0-84c59cbacc6d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.963020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df5f9-66f3-46ca-8756-7657ca531d0b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:27.972368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:27.973029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:27.973313 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:27.973584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:27.974282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:27.974563 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:27.976007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:27.994123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 89/172] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:27.994971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:28.040064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6a7c1-aee5-40fd-b1b9-f6c819a4ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:28.040806 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a7c1-aee5-40fd-b1b9-f6c819a4ef4f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.040993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a7c1-aee5-40fd-b1b9-f6c819a4ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.041245 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6a7c1-aee5-40fd-b1b9-f6c819a4ef4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.137000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a7c1-aee5-40fd-b1b9-f6c819a4ef4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:28.138516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6a7c1-aee5-40fd-b1b9-f6c819a4ef4f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:28.193472 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685467d1-0574-4b85-937d-e25ec33251e3 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:28.197360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:28.209204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:28.263040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:28.263662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.263942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.264564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.265331 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] RBAC: Adding query filter params (role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=2e6691a25aef4167ab313743eb7500d4) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:28.265636 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:28.267097 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:28.290026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 90/173] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:27 2022] GET /identity/v3/role_assignments?user.id=2e6691a25aef4167ab313743eb7500d4&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:28.291044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:28.346553 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 84/174] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:28.348649 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1da9ab-8f8f-4951-9579-30b568a6a9e9 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.353432 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1da9ab-8f8f-4951-9579-30b568a6a9e9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.354068 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1da9ab-8f8f-4951-9579-30b568a6a9e9 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.355967 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 85/175] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:28.366696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.367325 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.367821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.410848 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:28.412072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:28.494058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5044e6-91c5-4542-857a-ec1cae48c236 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:28.546572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 86/176] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:28.547494 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:28.582774 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547df5a0-51b8-4b8a-946b-0201e288785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:28.583441 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df5a0-51b8-4b8a-946b-0201e288785b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.583719 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df5a0-51b8-4b8a-946b-0201e288785b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.584024 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547df5a0-51b8-4b8a-946b-0201e288785b None admin] PATH_INFO: `/v3/users/34c7ada225bf4c9f83deb9a393935185` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.589710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df5a0-51b8-4b8a-946b-0201e288785b None admin] RBAC: Authorizing `identity:get_user(user_id=34c7ada225bf4c9f83deb9a393935185)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:28.591222 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547df5a0-51b8-4b8a-946b-0201e288785b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:28.593268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 91/177] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:28 2022] GET /identity/v3/users/34c7ada225bf4c9f83deb9a393935185 => generated 247 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:28.594471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4802-4bdd-4310-ac03-7276bc02f42b None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.594749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4802-4bdd-4310-ac03-7276bc02f42b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.595020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4802-4bdd-4310-ac03-7276bc02f42b None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.596223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 92/178] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:28.601356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4802-4bdd-4310-ac03-7276bc02f42b None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:28.646136 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:28.685245 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:28.730517 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a180b-b0be-473e-83ee-5dea50937ac1 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:28.735188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4802-4bdd-4310-ac03-7276bc02f42b None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:28.771904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3279d-a2b3-4dd6-beac-408d65bdc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:28.772600 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3279d-a2b3-4dd6-beac-408d65bdc76b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.772904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3279d-a2b3-4dd6-beac-408d65bdc76b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.773201 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3279d-a2b3-4dd6-beac-408d65bdc76b None admin] PATH_INFO: `/v3/projects/e905f3702e8d4bfa91686f1495f918a2` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.774382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3279d-a2b3-4dd6-beac-408d65bdc76b None admin] RBAC: Authorizing `identity:get_project(project_id=e905f3702e8d4bfa91686f1495f918a2)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:28.775874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3279d-a2b3-4dd6-beac-408d65bdc76b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:28.777314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fd798-2073-4d07-800e-c115b984c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:28.777614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 87/179] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:28 2022] GET /identity/v3/projects/e905f3702e8d4bfa91686f1495f918a2 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:28.777942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd798-2073-4d07-800e-c115b984c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.778223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd798-2073-4d07-800e-c115b984c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.778543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fd798-2073-4d07-800e-c115b984c1e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.778815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918218a7-39e6-4b0f-9c02-bd4204b2cbe7 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.779096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918218a7-39e6-4b0f-9c02-bd4204b2cbe7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.779363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918218a7-39e6-4b0f-9c02-bd4204b2cbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.799425 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-918218a7-39e6-4b0f-9c02-bd4204b2cbe7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:28.800603 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-918218a7-39e6-4b0f-9c02-bd4204b2cbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:28.855994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fd798-2073-4d07-800e-c115b984c1e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:28.857540 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fd798-2073-4d07-800e-c115b984c1e9 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:28.868177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 88/180] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:28.869836 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645d6d0-85a3-49ae-af8e-487e85d33f69 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.870283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645d6d0-85a3-49ae-af8e-487e85d33f69 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.870712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645d6d0-85a3-49ae-af8e-487e85d33f69 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.872127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 89/181] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:28.877478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b73b-fbee-45d9-9374-113513618dd2 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.877768 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b73b-fbee-45d9-9374-113513618dd2 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.878041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793b73b-fbee-45d9-9374-113513618dd2 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:28.879242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 90/182] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:28.880001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793b73b-fbee-45d9-9374-113513618dd2 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:28.892630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:28.955245 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:28.986353 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 93/183] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:32:28.987645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:28.987930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:28.988205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.004412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793b73b-fbee-45d9-9374-113513618dd2 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.007281 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:29.008487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:29.042448 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.043057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.043341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.043607 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.044326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=e905f3702e8d4bfa91686f1495f918a2, user.id=2e6691a25aef4167ab313743eb7500d4) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:29.044628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:29.046143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a6e16-8cab-4feb-9dd9-a260872e25d2 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:29.051962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 91/184] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:28 2022] GET /identity/v3/role_assignments?user.id=2e6691a25aef4167ab313743eb7500d4&scope.project.id=e905f3702e8d4bfa91686f1495f918a2&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:29.053326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.053645 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.054099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.076191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:29.077598 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:29.090664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 94/185] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:29.092608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.168206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:29.220922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4a0f8-d718-43c6-bd4e-14e60d55f03c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.221844 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 92/186] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:29.228277 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.278098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.278864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.279054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.279294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.291823 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:29.297714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:29.298588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 95/187] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:29.299387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.335928 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:29.409968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a83f9-a382-4ae9-a533-a71ae0511ee1 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.471122 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892df25-b025-48a0-b3c1-b205d66c354a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.485159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.485815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.486090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.486363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.493698 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:29.495195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:29.497316 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 93/188] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:29.498180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.501970 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:29.536780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.536780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.536780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.536780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.557508 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:29.564145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:29.565134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:29.565924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:29.570426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 96/189] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:29.571358 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.642640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b34433-ab1e-4be8-a8b1-c0346dd2f6bb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.665884 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:29.673781 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082799fa-a3e3-42ee-8d60-a7c7414ba3fd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.678780 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.679431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.679702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.679968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.680629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:29.680967 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:29.682351 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:29.695453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 94/190] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:29.695453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.713678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.714290 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.714554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.714819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.715539 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=34c7ada225bf4c9f83deb9a393935185) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:29.715837 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:29.717302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:29.722931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 97/191] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/role_assignments?user.id=34c7ada225bf4c9f83deb9a393935185&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:29.722931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.765703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:29.804591 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf72fc2-757a-4ec1-a063-0cffe16f58aa None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.834848 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9001a4-55bb-4357-a53d-ca55d17cdfd4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:29.848129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.849409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.849877 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.850148 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.851515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:29.853026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:29.859785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 95/192] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:29.859785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.876739 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:29.877427 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:29.877707 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:29.877983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:29.878663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:29.878967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:29.880377 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:29.890260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 98/193] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:29.891136 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:29.935765 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:29.990171 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728c7b2-1372-42fa-90e3-3ba681a88735 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.011931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.015617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7dc04-0d66-48cd-80b4-722efa20f5ba None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.024396 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.025051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.025323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.025591 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.035397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:30.040753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:30.041672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 96/194] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:30.045969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.052794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.053615 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.054217 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.054339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] PATH_INFO: `/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.068131 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] RBAC: Authorizing `identity:get_user(user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.069697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.071426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 99/195] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:29 2022] GET /identity/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:30.072192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.151405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e338dc-fcf9-469d-947d-1955a6ee74fe None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.165474 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.172777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fde96-d211-4a53-ab2b-86c45d9f1501 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.186865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.187467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.187739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.188001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.188635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.190127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.206986 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.207628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.207899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.208258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] PATH_INFO: `/v3/users/0d1c9a352dd44a27a6a2be16a77b67e8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.209410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] RBAC: Authorizing `identity:get_user(user_id=0d1c9a352dd44a27a6a2be16a77b67e8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.210963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.212263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 97/196] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:30 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:30.212535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 100/197] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/users/0d1c9a352dd44a27a6a2be16a77b67e8 => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:30.213131 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.213328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.249857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.333066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c31681e-cd73-49e8-bf6e-1449d3f24146 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.339202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26184c64-9181-4403-9a50-61a151a5cb39 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.372742 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.373397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.373668 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.373924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.375564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.376195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.376478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.376753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.377475 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:30.377780 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.379263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.388426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 98/198] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:30.389667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.423394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.463482 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.465039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.495772 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.516929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed288a6-4f5f-4472-a152-edf7b6854c8f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.561691 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.562723 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.562723 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.562914 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.592855 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 101/199] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:30.593556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.643894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.645334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.691016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.720875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65501bfb-226a-4e8c-baae-c78cf266d47d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.751668 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 99/200] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:30.752544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.757931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.782990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.783635 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.783912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.784192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] PATH_INFO: `/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.785360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] RBAC: Authorizing `identity:get_user(user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.786841 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.788714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 102/201] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:30.794012 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.870072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282b552-c98b-4fec-83fa-92e657920fe5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.894482 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85470-0cbc-4c35-8c1e-20d86265bc77 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:30.905930 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:30.912251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.913279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.914478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.915111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.916521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.918215 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.920139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 100/202] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:30.921196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:30.931921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:30.932564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:30.932866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:30.933162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:30.934361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:30.935929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:30.937624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 103/203] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:30.938397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:31.003817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:31.029450 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9b1c6-a168-461a-a3e3-a8fcd12ce50f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:31.047268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc06ef3-5275-4368-9f5d-7fb94c67e1f0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:31.067283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:31.068564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:31.069105 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:31.069576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:31.085879 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:31.086498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:31.086773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:31.087042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:31.087872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:31.088181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:31.090637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:31.098127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 104/204] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/role_assignments?user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:31.099127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:31.154605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:31.158794 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:31.160515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:31.254138 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948673e-d612-407e-be82-f7a6ae24acba None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:31.269159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 101/205] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:31.280898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:31.295407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:31.319451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:31.319451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:31.319451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:31.319891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:31.320675 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] RBAC: Adding query filter params (role.id=535025a1e39c4dd983e47ecbf0dbfe92, scope.project.id=95075c2c580f4f1894bbaa9d34591719, user.id=0d1c9a352dd44a27a6a2be16a77b67e8) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:31.321015 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:31.322520 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:31.329346 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 105/206] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:31 2022] GET /identity/v3/role_assignments?user.id=0d1c9a352dd44a27a6a2be16a77b67e8&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=535025a1e39c4dd983e47ecbf0dbfe92 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:31.395637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:31.400356 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543bd45-d499-4702-92ac-64c4010fa51d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:31.452617 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843e356-fcc5-49dd-a2f5-c951a77e9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:31.453568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843e356-fcc5-49dd-a2f5-c951a77e9817 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:31.453993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843e356-fcc5-49dd-a2f5-c951a77e9817 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:31.454409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843e356-fcc5-49dd-a2f5-c951a77e9817 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:31.455815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843e356-fcc5-49dd-a2f5-c951a77e9817 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:31.457536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843e356-fcc5-49dd-a2f5-c951a77e9817 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:31.459929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 102/207] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:31 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:31.466120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:31.603872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001cdec-d3f1-4853-a1ee-de53e611c3b0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:31.639620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:31.640242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:31.640517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:31.640781 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:31.641540 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] RBAC: Adding query filter params (role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:31.641840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:31.643294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05845e1a-1c8b-470b-8dfa-cb2fac0ea249 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:31.650059 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 106/208] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:31 2022] GET /identity/v3/role_assignments?user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:32.623868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af0a47-79ba-44d5-b264-fbbc304e24e2 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:32.624416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af0a47-79ba-44d5-b264-fbbc304e24e2 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:32.624416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af0a47-79ba-44d5-b264-fbbc304e24e2 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:32.626067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 103/209] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:32.631842 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc003-e1ad-4bb6-af3e-ac22a17cc048 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:32.632397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc003-e1ad-4bb6-af3e-ac22a17cc048 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:32.633120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcc003-e1ad-4bb6-af3e-ac22a17cc048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:32.659265 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-8fbcc003-e1ad-4bb6-af3e-ac22a17cc048 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:32.660504 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-8fbcc003-e1ad-4bb6-af3e-ac22a17cc048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:32.715155 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:32.734490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:32.814339 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bee0d-6598-42e4-b063-5a2d69a110c4 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:32.814958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bee0d-6598-42e4-b063-5a2d69a110c4 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:32.815445 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bee0d-6598-42e4-b063-5a2d69a110c4 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:32.817307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 104/211] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:32.823141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:32.823650 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:32.824113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:32.844702 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:32.846257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:32.914800 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 108/212] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:33.068718 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bee0d-6598-42e4-b063-5a2d69a110c4 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:33.184231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bee0d-6598-42e4-b063-5a2d69a110c4 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:33.218896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:33.219544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.219821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.220095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.230814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:33.235637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:33.236493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:33.237328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:33.241202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 105/213] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:33.243203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:33.247197 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:33.281232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:33.357292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ee4ad-a737-47b3-ad76-2ccac7457abc None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:33.375427 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e6cfb-b444-4342-897b-e83d509ab7cc None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:33.395991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:33.402762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:33.403702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.404194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.405217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.406807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:33.409570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:33.417556 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 106/214] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:33.418744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:33.426085 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:33.426998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.427465 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.427924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.429661 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:33.430189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:33.432555 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:33.447659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 109/215] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:33.453790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:33.528362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:33.536064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e862863-5c31-4233-a862-6330702ae265 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:33.572559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962c59d-e50e-43bc-9743-7ce8a3b21a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:33.573210 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962c59d-e50e-43bc-9743-7ce8a3b21a5c None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.573484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962c59d-e50e-43bc-9743-7ce8a3b21a5c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.573751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962c59d-e50e-43bc-9743-7ce8a3b21a5c None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.574416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962c59d-e50e-43bc-9743-7ce8a3b21a5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:33.575870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962c59d-e50e-43bc-9743-7ce8a3b21a5c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:33.591082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a963e9-4430-424b-bee6-d74c88f8015d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:33.611806 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 107/216] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:33 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:33.617058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09daf52-e427-4d05-8a94-b59849719213 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.617464 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09daf52-e427-4d05-8a94-b59849719213 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.617666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09daf52-e427-4d05-8a94-b59849719213 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.618998 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 108/217] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:33.624783 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddaed3-975c-4145-9f7a-1381c761a76e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.625444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddaed3-975c-4145-9f7a-1381c761a76e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.625444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddaed3-975c-4145-9f7a-1381c761a76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.642425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:33.643090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.643368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.645288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] PATH_INFO: `/v3/users/26bfcee25f8f4ff8928997e784eeb0e8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.647765 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-ebddaed3-975c-4145-9f7a-1381c761a76e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:33.649020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-ebddaed3-975c-4145-9f7a-1381c761a76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:33.667050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] RBAC: Authorizing `identity:get_user(user_id=26bfcee25f8f4ff8928997e784eeb0e8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:33.669394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:33.677281 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 110/218] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:33 2022] GET /identity/v3/users/26bfcee25f8f4ff8928997e784eeb0e8 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:33.679087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:33.729951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:33.759448 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 109/219] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:33.813278 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650fb80-9cfa-4a91-8191-f373d54e749d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:33.849722 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:33.850672 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.851088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.851496 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.893747 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9216fc-50d7-4efb-bef0-ff90f512f9bc None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.894050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9216fc-50d7-4efb-bef0-ff90f512f9bc None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.894321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9216fc-50d7-4efb-bef0-ff90f512f9bc None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.895808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 110/220] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:33.901948 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:33.902295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:33.902565 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:33.930902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:33.932075 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:33.933219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:33.934856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:33.970918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:34.018885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 111/221] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:34.051229 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 111/222] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:34.056852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.072345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:34.108809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.186126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d77c1e-4269-4576-8b18-7db2e4b95416 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.224026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.224676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.224991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.225303 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.226359 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57c54f-15b1-4e84-b881-1aa42e559732 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.226538 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:34.228149 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:34.230254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 112/223] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:34.236317 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.263648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.264790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.265150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.265488 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.267506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:34.279185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:34.283978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:34.284876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:34.285698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 112/224] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:34.291090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.349618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:34.391196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991020-ea82-4f80-b19b-09000f66ba17 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.457805 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.458435 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.458713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.459011 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.460387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=26bfcee25f8f4ff8928997e784eeb0e8) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:34.460694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:34.462204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:34.462916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fea3d-09d3-4467-a43f-2e0ae11ece6c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.469296 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 113/225] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/role_assignments?user.id=26bfcee25f8f4ff8928997e784eeb0e8&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:34.470228 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.504439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f07df-2088-407c-8857-1534507d78dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.505231 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f07df-2088-407c-8857-1534507d78dc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.505504 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f07df-2088-407c-8857-1534507d78dc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.505770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f07df-2088-407c-8857-1534507d78dc None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.506714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f07df-2088-407c-8857-1534507d78dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:34.507015 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f07df-2088-407c-8857-1534507d78dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:34.508656 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f07df-2088-407c-8857-1534507d78dc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:34.519386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 113/226] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:34.526203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f07df-2088-407c-8857-1534507d78dc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.602008 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:34.676003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c341a42-7857-4ffb-98e2-7033862da044 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.709959 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f07df-2088-407c-8857-1534507d78dc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.737055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.737704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.737981 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.738250 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.761685 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:34.768387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:34.769335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:34.770132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:34.773263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.774072 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.774477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.774873 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] PATH_INFO: `/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.776138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.776993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] RBAC: Authorizing `identity:get_user(user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:34.778653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:34.780468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 114/228] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:34.783402 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:34.787558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:34.894798 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd357-a2ce-45e7-a584-a85e84e13f7a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:34.930622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:34.931245 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:34.931515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:34.931782 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:34.932445 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:34.932741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:34.934762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:34.943775 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 115/229] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:34.949471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:35.021294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:35.062240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bfeec-46a1-42dd-9b72-eaea6ab3b754 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:35.098199 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:35.099037 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:35.099363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:35.099636 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] PATH_INFO: `/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:35.101058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] RBAC: Authorizing `identity:get_user(user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:35.102618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:35.104538 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 116/230] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:35.110112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:35.174910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3606ff8-74ca-4e2f-992a-a23b81ef4d1b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:35.218460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:35.223692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbb6a1-48ee-4fc7-b982-3b567ce2a688 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:35.249575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:35.250238 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:35.250521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:35.250798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:35.252013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:35.253498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:35.255467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 115/231] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:34 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:35.258082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:35.263089 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:35.265738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:35.266389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:35.266667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:35.266941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:35.268063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:35.269864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:35.271928 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 117/232] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:35 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:35.277733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:35.369726 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9da7d-e56e-43cb-844e-2e5db37a28ae None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:35.404775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebffa44-8cce-491d-99eb-a060242a19e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:35.405474 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebffa44-8cce-491d-99eb-a060242a19e8 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:35.405753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebffa44-8cce-491d-99eb-a060242a19e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:35.406028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebffa44-8cce-491d-99eb-a060242a19e8 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:35.407966 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebffa44-8cce-491d-99eb-a060242a19e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1bb4b1128489e93c1636c7cb2148a, user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:35.409464 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebffa44-8cce-491d-99eb-a060242a19e8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:35.437175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 116/233] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:35 2022] PUT /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:35.493287 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f400f7-cbb3-4987-b6a8-d4b948e99486 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:35.537521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8620a28-44e7-4e59-b81c-38cf1cfe9d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:35.538238 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8620a28-44e7-4e59-b81c-38cf1cfe9d2e None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:35.538511 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8620a28-44e7-4e59-b81c-38cf1cfe9d2e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:35.538779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8620a28-44e7-4e59-b81c-38cf1cfe9d2e None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3/roles/0c3434548fa045d9a248a23fd0a93fa4` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:35.541100 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8620a28-44e7-4e59-b81c-38cf1cfe9d2e None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1bb4b1128489e93c1636c7cb2148a, user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3, role_id=0c3434548fa045d9a248a23fd0a93fa4)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:35.542587 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8620a28-44e7-4e59-b81c-38cf1cfe9d2e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:35.567261 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 118/234] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:35 2022] PUT /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3/roles/0c3434548fa045d9a248a23fd0a93fa4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:32:36.389203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5250-fbab-44e8-ab22-3fa461991a01 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:36.390506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5250-fbab-44e8-ab22-3fa461991a01 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:36.390997 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f5250-fbab-44e8-ab22-3fa461991a01 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:36.392870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 117/235] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:36.398262 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f66e5-7088-4572-a45a-3b4e11002a6a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:36.399107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f66e5-7088-4572-a45a-3b4e11002a6a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:36.399582 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f66e5-7088-4572-a45a-3b4e11002a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:36.426524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-3f1f66e5-7088-4572-a45a-3b4e11002a6a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:36.428063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-3f1f66e5-7088-4572-a45a-3b4e11002a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:36.495632 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:36.508053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 119/236] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:36.858961 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a483d-0b10-4e9e-a597-cdf215b438da None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:36.859348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a483d-0b10-4e9e-a597-cdf215b438da None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:36.859543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a483d-0b10-4e9e-a597-cdf215b438da None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:36.860986 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 118/237] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:36.866046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:36.866762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:36.866762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:36.893918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:36.895134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:36.954917 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a483d-0b10-4e9e-a597-cdf215b438da None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:36.993752 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 120/238] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:37.071517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:37.148696 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a483d-0b10-4e9e-a597-cdf215b438da None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:37.199180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:37.199820 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.200099 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.200369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.210602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:37.215827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:37.216698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:37.217518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 119/239] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:37.223058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:37.326888 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6d2ee-3895-40b5-913f-05fc01b14179 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:37.348321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:37.363011 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:37.363956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.364547 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.365097 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.366269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:37.366788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:37.368113 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b73eb-571e-4275-8ef6-21682a6fcc7a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:37.376438 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 121/240] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:37.382916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:37.388663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3527b8-9429-40b7-b106-3fd90ca9085a None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.388964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3527b8-9429-40b7-b106-3fd90ca9085a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.389230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3527b8-9429-40b7-b106-3fd90ca9085a None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.391128 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 122/241] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:37.401180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.402524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.402524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.432514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:37.433740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:37.504490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11e37b-5d7d-4708-baa7-bb80ece0638a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:37.518657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:37.519696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 123/242] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 03 20:32:37.520923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:37.576116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:37.576773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.577077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.577350 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] PATH_INFO: `/v3/users/065da912838c450baa43c00f23886d7f` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.613560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] RBAC: Authorizing `identity:get_user(user_id=065da912838c450baa43c00f23886d7f)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:37.615050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:37.617386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 120/243] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:37 2022] GET /identity/v3/users/065da912838c450baa43c00f23886d7f => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:37.622851 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:37.631455 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ef5e6-07d6-4298-b006-386d9b28cc85 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:37.648137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:37.672503 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:37.673182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.673458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.673727 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.674824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:37.676552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:37.678823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 124/244] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:37.684426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:37.793124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215e779-607a-43ea-8ece-0566c295a65f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:37.828661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:37.829457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.829729 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.829992 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.830693 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:37.832142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:37.836971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5eedc-a292-47f2-b8ca-3a939e08bd6a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:37.864899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 125/245] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:37 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:37.898319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:37.898515 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:37.898731 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:37.898991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:37.954021 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:37.999311 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:38.000862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:38.046720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.149333 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:38.178839 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 121/246] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:32:38.184864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.209169 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20704b1a-fc9b-4689-9920-263f2b691f4f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:38.247328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd9ed0-c1a1-4564-ac6c-b296c2b8bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:38.248061 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9ed0-c1a1-4564-ac6c-b296c2b8bf62 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.248342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9ed0-c1a1-4564-ac6c-b296c2b8bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.248614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9ed0-c1a1-4564-ac6c-b296c2b8bf62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.258877 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:38.263330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd9ed0-c1a1-4564-ac6c-b296c2b8bf62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-bffd9ed0-c1a1-4564-ac6c-b296c2b8bf62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:38.269808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:38.270824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:38.271748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 126/247] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:38.273326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125c41-f268-4a72-b489-0ca9e621405e None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.273480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125c41-f268-4a72-b489-0ca9e621405e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.273746 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72125c41-f268-4a72-b489-0ca9e621405e None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.275169 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 127/248] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:38.279690 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72125c41-f268-4a72-b489-0ca9e621405e None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.300444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb074d9-0d10-48f2-9610-6add3ddb5d35 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:38.340095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d14de-24c2-443a-ac7c-e9236bb0f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:38.340737 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d14de-24c2-443a-ac7c-e9236bb0f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.341049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d14de-24c2-443a-ac7c-e9236bb0f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.341778 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d14de-24c2-443a-ac7c-e9236bb0f9d4 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.342962 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d14de-24c2-443a-ac7c-e9236bb0f9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:38.344420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d14de-24c2-443a-ac7c-e9236bb0f9d4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:38.348882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 122/249] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:38.348882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac17c-356a-4a67-bdd1-a07af98da06a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.348882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac17c-356a-4a67-bdd1-a07af98da06a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.348882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac17c-356a-4a67-bdd1-a07af98da06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.372630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-4eaac17c-356a-4a67-bdd1-a07af98da06a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:38.373891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-4eaac17c-356a-4a67-bdd1-a07af98da06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:38.409072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:38.416852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72125c41-f268-4a72-b489-0ca9e621405e None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:38.466429 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 123/250] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:38.467741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46172-95c6-4993-9aa0-23e6e1502c0c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.468020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46172-95c6-4993-9aa0-23e6e1502c0c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.468283 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd46172-95c6-4993-9aa0-23e6e1502c0c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.471716 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:38.471716 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.472033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.472251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.472954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:38.473258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:38.474417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 124/251] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:38.474652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd917a-eddc-4670-869c-95154e5cc201 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:38.475676 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46172-95c6-4993-9aa0-23e6e1502c0c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.486666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 128/252] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:38.488276 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.492860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.493522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.513717 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:38.515646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:38.552720 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:38.587659 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 129/253] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:38.589009 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.590678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd46172-95c6-4993-9aa0-23e6e1502c0c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:38.628021 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:38.628761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.629031 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.629306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.630042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] RBAC: Adding query filter params (role.id=535025a1e39c4dd983e47ecbf0dbfe92, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=065da912838c450baa43c00f23886d7f) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:38.636858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:38.636858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:38.638043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 125/254] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/role_assignments?user.id=065da912838c450baa43c00f23886d7f&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=535025a1e39c4dd983e47ecbf0dbfe92 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:38.726846 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:38.741751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027c83-35ff-464b-93a9-df0c0f37cb79 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:38.793458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:38.794544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.795025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.795517 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] PATH_INFO: `/v3/users/26bfcee25f8f4ff8928997e784eeb0e8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.797902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] RBAC: Authorizing `identity:get_user(user_id=26bfcee25f8f4ff8928997e784eeb0e8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:38.799616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:38.801532 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 130/255] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/users/26bfcee25f8f4ff8928997e784eeb0e8 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:38.807653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.929014 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:38.944953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b479070-6244-4bac-8454-2438fb5f77ba None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:38.993300 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:38.996039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:38.996690 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:38.997008 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:38.997312 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:38.999052 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:39.000526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:39.002574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 126/256] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:39.010481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:39.115652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739ee8d-6b08-446d-8edc-45a3b02393b6 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:39.189269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:39.189925 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:39.190202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:39.190473 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:39.201241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebe297-cc8b-4dfa-a9ea-8ab483702981 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:39.212669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:39.217559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:39.218434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:39.219237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 131/257] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:39.219901 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:39.257459 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:39.263512 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:39.264195 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:39.264815 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:39.265449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/26bfcee25f8f4ff8928997e784eeb0e8/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:39.268266 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1bb4b1128489e93c1636c7cb2148a, user_id=26bfcee25f8f4ff8928997e784eeb0e8, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:39.270410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:39.295718 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 127/258] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:39 2022] PUT /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/26bfcee25f8f4ff8928997e784eeb0e8/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:39.296556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:39.425209 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:39.431205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebb59-3bf1-4924-af51-4ea823d1932a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:39.511831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:39.512403 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:39.512684 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:39.512989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:39.515743 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41bda7-0cd9-49a6-9895-249c292ae82e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:39.530408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:39.535258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:39.536145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:39.537144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 132/259] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:39.543567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:39.567258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:39.567934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:39.568146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:39.568416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:39.569404 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:39.569982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:39.570944 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:39.580718 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 128/260] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:39.586900 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:39.689443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:39.726520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcd447-2f46-4027-ba4d-62401a998225 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:39.797112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:39.797659 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:39.797935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:39.798200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:39.798875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:39.799174 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:39.800612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:39.818286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a8f1d-a2c5-47ef-b288-d2de74387d2d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:39.819534 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 133/261] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:39.826792 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:39.869184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:39.892543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:39.893464 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:39.893751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:39.894026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] PATH_INFO: `/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:39.898005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] RBAC: Authorizing `identity:get_user(user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:39.899544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:39.901426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 129/262] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:39 2022] GET /identity/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:39.906845 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:40.036713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab5be0-e652-4b03-8f10-9e487ee4bafe None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:40.095655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ae816-3386-4df0-b3a6-97fdb8146914 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:40.127779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:40.127779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:40.127779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:40.127779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] PATH_INFO: `/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:40.128181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] RBAC: Authorizing `identity:get_user(user_id=5e60ef2f3a8a4f52a9bd2ef4af580ef3)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:40.129906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:40.135965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 134/263] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:39 2022] GET /identity/v3/users/5e60ef2f3a8a4f52a9bd2ef4af580ef3 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:40.138209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:40.153614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:40.176628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:40.177659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:40.178141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:40.178929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:40.293207 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:40.320277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:40.321914 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:40.330019 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ffba-e81b-4c82-8a56-261475e3cb10 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:40.368673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:40.369237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:40.369511 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:40.369790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:40.478532 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:40.480015 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:40.483053 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 130/264] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:32:40.489635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:40.498179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:40.706153 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:40.714153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 135/265] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:40.720508 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:40.733180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b2f8d-87b7-4103-8fc0-b8b229a9afa1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:40.809421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:40.810075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:40.812093 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:40.812367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:40.814807 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:40.816298 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:40.818013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 131/266] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:40 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:40.824691 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:40.984932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8545712-d2f2-488e-9aaf-20b1272343b3 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:40.998132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:41.004505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6953c6-5df9-45c0-a969-fdbc94e48051 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:41.073207 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:41.074379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.074855 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.075319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.078084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:41.079187 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:41.081408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 136/267] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:40 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:41.087485 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:41.089839 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:41.090732 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.091056 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.091324 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.092175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] RBAC: Adding query filter params (role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:41.092479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:41.094602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ff066-0f5f-4475-8fa1-4c9834fd1bab None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:41.107899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 132/268] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:40 2022] GET /identity/v3/role_assignments?user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:41.261075 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ff333-e4b7-4cd2-befd-4e446ab37f1a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:41.288923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ccb51-2f17-4c63-b267-a66c6039804e None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.289321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ccb51-2f17-4c63-b267-a66c6039804e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.289423 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ccb51-2f17-4c63-b267-a66c6039804e None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.290827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 133/269] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:41.306775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4d70-9cd3-4184-a273-dabcecaa3ffc None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.307091 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4d70-9cd3-4184-a273-dabcecaa3ffc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.307319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b4d70-9cd3-4184-a273-dabcecaa3ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.327134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:41.327776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.328118 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.328393 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.329171 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:41.329477 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:41.333457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38542e00-59e5-426b-baf8-b433e1e1e797 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:41.337918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-ec8b4d70-9cd3-4184-a273-dabcecaa3ffc None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:41.339211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-ec8b4d70-9cd3-4184-a273-dabcecaa3ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:41.340627 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 137/270] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:41 2022] GET /identity/v3/role_assignments?user.id=5e60ef2f3a8a4f52a9bd2ef4af580ef3&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:41.373295 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:41.466760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 134/271] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:41.490518 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708982e-5ecf-4fa0-973b-8db84bb9a643 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.491140 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708982e-5ecf-4fa0-973b-8db84bb9a643 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.491140 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708982e-5ecf-4fa0-973b-8db84bb9a643 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.493224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 138/272] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:41.500116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff9ef-d5b5-453e-88f8-eeb51daf0f1b None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.500425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff9ef-d5b5-453e-88f8-eeb51daf0f1b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.500668 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cff9ef-d5b5-453e-88f8-eeb51daf0f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.532248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-93cff9ef-d5b5-453e-88f8-eeb51daf0f1b None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:41.533397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-93cff9ef-d5b5-453e-88f8-eeb51daf0f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:41.622328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 135/273] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:41.890416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708982e-5ecf-4fa0-973b-8db84bb9a643 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:41.947308 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:41.955361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a701081-636e-4e88-91d2-f5ff622b0fb9 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.955361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a701081-636e-4e88-91d2-f5ff622b0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.955361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a701081-636e-4e88-91d2-f5ff622b0fb9 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.956872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 136/274] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:41.962342 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:41.962625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:41.962899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:41.991586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:41.991586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:42.029619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708982e-5ecf-4fa0-973b-8db84bb9a643 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.065916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 137/275] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:42.066111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.066579 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.066766 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.067002 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.067274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.068386 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:42.070409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:42.073201 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 139/276] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:42.078993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.084426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:42.210107 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13685e8-6b84-4762-b614-cfe3f3ef92de None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.214207 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d27f18-a337-4324-95d3-0335293ebfa4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.222685 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:42.247946 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.248711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.249025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.249473 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.259950 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.260989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.261605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.261710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:42.262173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.263091 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:42.265259 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:42.267082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:42.268101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:42.269118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 138/277] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:42.274860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.296405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 140/278] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:32:42 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:42.365552 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:42.403082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15998938-6036-4fbe-974e-3ab0b0c6d9b1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.443205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.443896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.444230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.444725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.445568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:42.445875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:42.447446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:42.449571 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.458017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 139/279] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:42.467107 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.588904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be736a7-85da-4c9a-9a2a-a1a6df2bc361 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.607545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3815cb4-5cb3-4616-9ad2-d25eb71cbbdc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.634230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788012c-9aa9-442a-90b5-765a0983b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.634908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788012c-9aa9-442a-90b5-765a0983b16a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.635188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788012c-9aa9-442a-90b5-765a0983b16a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.635465 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788012c-9aa9-442a-90b5-765a0983b16a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.648419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788012c-9aa9-442a-90b5-765a0983b16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:42.654221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fd886-d915-4b7a-a3d5-1cfce4ee879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-7788012c-9aa9-442a-90b5-765a0983b16a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:42.654699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:42.655882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:42.657025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:42.657639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd886-d915-4b7a-a3d5-1cfce4ee879f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.657639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd886-d915-4b7a-a3d5-1cfce4ee879f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.657639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fd886-d915-4b7a-a3d5-1cfce4ee879f None admin] PATH_INFO: `/v3/users/75bfa1bb0486445b8b236a2d912729ff` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.659502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:42.659840 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 141/280] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:42.661540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa102a0a-4ce4-4a69-bc6c-2e1c51625d00 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.661912 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa102a0a-4ce4-4a69-bc6c-2e1c51625d00 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.662186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa102a0a-4ce4-4a69-bc6c-2e1c51625d00 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.664305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 142/281] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:42.667703 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa102a0a-4ce4-4a69-bc6c-2e1c51625d00 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.677546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd886-d915-4b7a-a3d5-1cfce4ee879f None admin] RBAC: Authorizing `identity:get_user(user_id=75bfa1bb0486445b8b236a2d912729ff)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:42.679194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fd886-d915-4b7a-a3d5-1cfce4ee879f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:42.681453 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 140/282] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/users/75bfa1bb0486445b8b236a2d912729ff => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:42.683550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.683829 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.684094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.698317 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:42.709091 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:42.710533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:42.802707 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 141/283] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:42.803956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.816342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa102a0a-4ce4-4a69-bc6c-2e1c51625d00 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.885804 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.886283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.886562 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.886831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.887499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:42.887795 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:42.889718 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:42.907089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 143/284] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:42.921855 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87735fd-4a77-4f41-bd9f-8b16647027af None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:42.925488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:42.951344 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:42.964210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:42.965546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:42.965969 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:42.966384 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:42.967300 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, user.id=75bfa1bb0486445b8b236a2d912729ff, scope.system=all) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:42.967826 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:42.969476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:42.976056 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 142/285] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/role_assignments?user.id=75bfa1bb0486445b8b236a2d912729ff&scope.system=all&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:43.064895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:43.085905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1340100b-01b5-4eaa-ab19-be8b91abcd5a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:43.148087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:43.149044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:43.149847 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:43.150287 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] PATH_INFO: `/v3/users/065da912838c450baa43c00f23886d7f` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:43.151726 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] RBAC: Authorizing `identity:get_user(user_id=065da912838c450baa43c00f23886d7f)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:43.153437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:43.159643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 144/286] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:42 2022] GET /identity/v3/users/065da912838c450baa43c00f23886d7f => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:43.162192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:43.312736 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2472d15-7055-491a-b31d-fec32e3584a7 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:43.344413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:43.353440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:43.353440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:43.353440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:43.353440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:43.354739 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:43.356201 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:43.359333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 143/287] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:43 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:43.364576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:43.428861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:43.473116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194bc9-04d3-4352-9fb1-9048e91d7a15 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:43.510774 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:43.511444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:43.511723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:43.511997 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/065da912838c450baa43c00f23886d7f/roles/535025a1e39c4dd983e47ecbf0dbfe92` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:43.515936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c506d23-be82-48ec-937b-0fe6a156fb3f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:43.522286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1bb4b1128489e93c1636c7cb2148a, user_id=065da912838c450baa43c00f23886d7f, role_id=535025a1e39c4dd983e47ecbf0dbfe92)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:43.523893 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:43.549981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 144/288] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:32:43 2022] PUT /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/users/065da912838c450baa43c00f23886d7f/roles/535025a1e39c4dd983e47ecbf0dbfe92 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:43.562851 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:43.564078 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:43.564547 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:43.565188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:43.593786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:43.599770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:43.601193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:43.601994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:43.612143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 145/289] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:43.613162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:43.781517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedc31f-24a1-4d72-a145-2c9d66a40aae None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:43.806825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:43.833884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:43.834753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:43.835070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:43.835341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:43.836006 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:43.836301 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:43.837733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:43.846859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 145/290] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:43.853155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:43.868699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:43.960188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e8600-81ec-4b1a-a56a-429c87a943f8 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:43.999196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:43.999832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:44.000101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:44.000364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] PATH_INFO: `/v3/users/26bfcee25f8f4ff8928997e784eeb0e8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:44.005667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] RBAC: Authorizing `identity:get_user(user_id=26bfcee25f8f4ff8928997e784eeb0e8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:44.007267 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:44.009291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 146/291] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:43 2022] GET /identity/v3/users/26bfcee25f8f4ff8928997e784eeb0e8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:44.015234 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:44.147706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b3b5-5736-4777-b93a-49d6fdcc4b48 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:44.190983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:44.191599 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:44.191871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:44.192136 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:44.256090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:44.284326 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:44.285844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:44.405152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 146/292] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:44.410828 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:44.494000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:44.514930 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb1908-710d-4291-8b91-b98f21197d2a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:44.551107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c630c9-0e18-4a6e-af7d-f2b07a1cae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:44.551738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c630c9-0e18-4a6e-af7d-f2b07a1cae11 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:44.552010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c630c9-0e18-4a6e-af7d-f2b07a1cae11 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:44.552274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c630c9-0e18-4a6e-af7d-f2b07a1cae11 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:44.553592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c630c9-0e18-4a6e-af7d-f2b07a1cae11 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:44.555094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c630c9-0e18-4a6e-af7d-f2b07a1cae11 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:44.557104 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 147/293] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:44 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:44.562833 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:44.673687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:44.699212 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b161b3-0e76-4d0f-8c28-09d55308deed None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:44.734619 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:44.735247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:44.735525 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:44.735798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:44.736524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=26bfcee25f8f4ff8928997e784eeb0e8) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:44.736844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:44.738286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17387b2-c2be-430c-a07f-2e99ce3ea829 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:44.744442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 147/294] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:44 2022] GET /identity/v3/role_assignments?user.id=26bfcee25f8f4ff8928997e784eeb0e8&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:45.167347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70211-4501-48c6-99ae-c2e073f454ac None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.167902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70211-4501-48c6-99ae-c2e073f454ac None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.167902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca70211-4501-48c6-99ae-c2e073f454ac None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.169252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 148/295] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:45.174691 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.176099 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.176208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91f5e-45fd-4208-a888-3218b8e7b6e0 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.176387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91f5e-45fd-4208-a888-3218b8e7b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.176478 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.176652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91f5e-45fd-4208-a888-3218b8e7b6e0 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.178187 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 149/296] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:45.183027 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.183299 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.183561 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.199174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:45.200362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:45.202385 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:45.203552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:45.294224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 150/297] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:45.297477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 148/298] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:45.614705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:45.620438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:45.719250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:45.722205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:45.749373 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417934c-324e-4294-8181-3e3ec02f0001 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:45.757213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0ce7b-0f9d-4925-a9f0-eef61b3076a5 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:45.790797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:45.792423 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.793193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.793673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.794938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:45.796482 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:45.797475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:45.800863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 151/299] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:45.802960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.803487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.803940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.804200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:45.815713 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:45.821152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:45.822068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:45.822866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:45.825553 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 149/300] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:45.832074 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:45.917909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107681e0-bb22-4e1b-bce2-16fa3feafd85 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:45.955109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd6775-e474-4ddc-a317-af59a26497aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:45.955470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafb3b5-2ca8-4160-a32e-fe0d0955b0bd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:45.955726 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd6775-e474-4ddc-a317-af59a26497aa None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.956000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd6775-e474-4ddc-a317-af59a26497aa None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.956274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd6775-e474-4ddc-a317-af59a26497aa None admin] PATH_INFO: `/v3/groups` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.957093 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd6775-e474-4ddc-a317-af59a26497aa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:45.959349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd6775-e474-4ddc-a317-af59a26497aa None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:45.980558 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 152/301] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Sep 3 20:32:45 2022] POST /identity/v3/groups => generated 229 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:45.981911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af9a62-b4cf-462c-ae0d-5eb62f76808e None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.982231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af9a62-b4cf-462c-ae0d-5eb62f76808e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.982504 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af9a62-b4cf-462c-ae0d-5eb62f76808e None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:45.984003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 153/302] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:45.989766 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:45.990060 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:45.990320 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.000001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:46.006866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:46.010137 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.011224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.011710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.012493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.013664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:46.014185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:46.014356 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:46.015894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:46.016605 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:46.033409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 150/303] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:46.038787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:46.116700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 154/304] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:46.191220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7524f2-d3ea-4701-8452-3db5ac744f08 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:46.228044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741588d-b2fb-4750-b34a-e5e78944e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.228687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741588d-b2fb-4750-b34a-e5e78944e140 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.229022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741588d-b2fb-4750-b34a-e5e78944e140 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.229294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741588d-b2fb-4750-b34a-e5e78944e140 None admin] PATH_INFO: `/v3/users/7ec1178f42ba4499a9b27c477cc1c003` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.248349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741588d-b2fb-4750-b34a-e5e78944e140 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec1178f42ba4499a9b27c477cc1c003)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:46.250205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741588d-b2fb-4750-b34a-e5e78944e140 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:46.252135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 151/305] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/users/7ec1178f42ba4499a9b27c477cc1c003 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:46.258697 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:46.332288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e39c0-4658-427e-99c9-befc9773c92b None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.332953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e39c0-4658-427e-99c9-befc9773c92b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.333231 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e39c0-4658-427e-99c9-befc9773c92b None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.335223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 152/306] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:46.342261 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.342663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.343034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.361968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:46.363338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:46.370378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e532d6d-d5c8-463e-8675-30ad3e20e036 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:46.409700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.410327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.410605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.410874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.411605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] RBAC: Adding query filter params (role.id=535025a1e39c4dd983e47ecbf0dbfe92, user.id=7ec1178f42ba4499a9b27c477cc1c003, scope.system=all) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:46.411909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:46.413581 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:46.417472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:46.422044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 155/307] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/role_assignments?user.id=7ec1178f42ba4499a9b27c477cc1c003&scope.system=all&role.id=535025a1e39c4dd983e47ecbf0dbfe92 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:46.423692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:46.452957 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 153/308] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:46.471657 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:46.587528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d748ca-23ac-46f8-9b23-05cfc1ae8235 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:46.625155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.625895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.626245 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.637401 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:46.642852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:46.643897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:46.644904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:46.646381 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 156/309] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:46.652367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:46.754442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3621ff-83cc-472d-bb36-646733b7fec1 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:46.789261 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.789872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.790140 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.790404 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.791063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:46.791356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:46.792727 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:46.801423 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 154/310] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:46.806995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:46.810886 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:46.857182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:46.885028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:46.925315 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a9daf-a7c6-4bcb-b6cc-3636e698270f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:46.942283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3ce0-0034-4a4d-bb75-d19ee33bbcd8 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:46.966844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.967492 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.967763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.968030 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.982777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:46.983890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:46.984761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:46.985284 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:46.985742 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] PATH_INFO: `/v3/users/75bfa1bb0486445b8b236a2d912729ff` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:46.987085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] RBAC: Authorizing `identity:get_user(user_id=75bfa1bb0486445b8b236a2d912729ff)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:46.988258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:46.989186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:46.989981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:46.991809 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:46.993973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 157/311] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/users/75bfa1bb0486445b8b236a2d912729ff => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:46.994319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 155/312] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:46.995711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:47.004954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:47.098961 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78e635-059a-46c7-9b8a-fbef766a233a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:47.110213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c62d2-2361-4d9e-98ce-58c37a8167f1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:47.111818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:47.133482 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:47.142270 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:47.142889 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:47.143166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:47.143437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:47.144111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:47.144419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:47.145859 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:47.156647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:47.158164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:47.158681 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:47.159144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] PATH_INFO: `/v3/system/users/75bfa1bb0486445b8b236a2d912729ff/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:47.160770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=75bfa1bb0486445b8b236a2d912729ff, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:47.162046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 158/313] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:47.162818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:47.163473 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:47.176665 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 156/314] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Sep 3 20:32:47 2022] PUT /identity/v3/system/users/75bfa1bb0486445b8b236a2d912729ff/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:47.289154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4660920-ff54-4b38-bdfa-f91127f80848 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:47.327079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:47.328127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:47.328592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:47.329104 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] PATH_INFO: `/v3/users/065da912838c450baa43c00f23886d7f` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:47.330496 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=065da912838c450baa43c00f23886d7f)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:47.332222 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:47.334583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 159/315] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:47 2022] GET /identity/v3/users/065da912838c450baa43c00f23886d7f => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:47.342053 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:47.457930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bd348-1cf7-4d8c-a921-81859561dc76 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:47.493182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:47.494099 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:47.494548 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:47.495025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:47.529856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:47.573640 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:47.575386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:47.680679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 157/316] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:47.686607 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:47.747845 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:47.792666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035d7d3-70de-49f5-aec1-bc6184729eb0 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:47.826796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76cab5-5c80-49fa-ab18-c08b1eb2637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:47.827738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76cab5-5c80-49fa-ab18-c08b1eb2637a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:47.828239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76cab5-5c80-49fa-ab18-c08b1eb2637a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:47.828705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76cab5-5c80-49fa-ab18-c08b1eb2637a None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:47.830021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76cab5-5c80-49fa-ab18-c08b1eb2637a None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:47.831701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76cab5-5c80-49fa-ab18-c08b1eb2637a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:47.833559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 160/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:47 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:47.842332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:47.914980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:47.950411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bcd74-3b6e-4ade-9f21-d3f6591ae2e7 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:47.984772 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:47.985418 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:47.985689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:47.985953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:47.986674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] RBAC: Adding query filter params (role.id=535025a1e39c4dd983e47ecbf0dbfe92, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a, user.id=065da912838c450baa43c00f23886d7f) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:47.986971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:47.988479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1c71a-c735-4327-be7b-7efaecb14c18 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:47.995036 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 158/318] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:32:47 2022] GET /identity/v3/role_assignments?user.id=065da912838c450baa43c00f23886d7f&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=535025a1e39c4dd983e47ecbf0dbfe92 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:48.364094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139055c-f3a5-484a-9aad-a98ed1468c2f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:48.364702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139055c-f3a5-484a-9aad-a98ed1468c2f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:48.364932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139055c-f3a5-484a-9aad-a98ed1468c2f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:48.366460 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 161/319] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:48.371867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32867a6-a5cb-4858-aa2d-7c2710d6921c None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:48.372382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32867a6-a5cb-4858-aa2d-7c2710d6921c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:48.372382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32867a6-a5cb-4858-aa2d-7c2710d6921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:48.391687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-e32867a6-a5cb-4858-aa2d-7c2710d6921c None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:48.392811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-e32867a6-a5cb-4858-aa2d-7c2710d6921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:48.467036 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 159/320] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:48.666309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a38100-c702-4a1e-880a-3bbfe14ab4b7 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:48.666488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a38100-c702-4a1e-880a-3bbfe14ab4b7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:48.666734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a38100-c702-4a1e-880a-3bbfe14ab4b7 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:48.668079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 162/321] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:48.673434 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:48.673721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:48.673990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:48.692323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:48.693534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:48.751433 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:48.763874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 160/322] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:48.783656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a38100-c702-4a1e-880a-3bbfe14ab4b7 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:48.891306 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a38100-c702-4a1e-880a-3bbfe14ab4b7 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:48.918667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:48.932634 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:48.933323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:48.933595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:48.933869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] PATH_INFO: `/v3/domains/default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:48.934962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:48.936393 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:48.938155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 163/323] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:32:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:48.943617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:49.043070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c30781-1990-4bf4-980d-947bee70cfc2 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:49.079148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:49.079759 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.080030 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.080292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] PATH_INFO: `/v3/groups` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.080945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:49.082381 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:49.085624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:49.113029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 161/324] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Sep 3 20:32:48 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:32:49.200575 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b036490-4a76-4f6f-931a-cbd08cf0807f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:49.236029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:49.236673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.236978 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.237247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.248879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:49.254346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:49.255322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:49.261155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 164/325] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:49.262427 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:49.316323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:49.381186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3dabad-8e83-46e2-a33f-7f3752d6d710 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:49.415689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:49.416304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.416577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.416891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.417554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:49.417849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:49.419224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8fec8-8f19-4ac9-a86e-67f65d914223 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:49.429645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 162/326] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:49.435380 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:49.491544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:49.510871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9d5f-13f5-436a-8f13-956ccfd4d539 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.511146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9d5f-13f5-436a-8f13-956ccfd4d539 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.511415 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9d5f-13f5-436a-8f13-956ccfd4d539 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.512807 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 163/327] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:49.518304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.518575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.518840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.537594 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:49.538878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:49.544391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa5302-a117-40e9-96fe-ea0e9f4bb802 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:49.589530 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:49.590765 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.591180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.591916 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] PATH_INFO: `/v3/users/7ec1178f42ba4499a9b27c477cc1c003` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.593178 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] RBAC: Authorizing `identity:get_user(user_id=7ec1178f42ba4499a9b27c477cc1c003)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:49.594642 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:49.596426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 165/328] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:49 2022] GET /identity/v3/users/7ec1178f42ba4499a9b27c477cc1c003 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:49.602134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:49.626227 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 164/329] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:49.724107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a4a58-480e-4e17-a796-7a43fc06e17b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:49.748596 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:49.761936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:49.762798 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:49.763152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:49.763561 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] PATH_INFO: `/v3/system/users/7ec1178f42ba4499a9b27c477cc1c003/roles/535025a1e39c4dd983e47ecbf0dbfe92` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:49.765349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7ec1178f42ba4499a9b27c477cc1c003, role_id=535025a1e39c4dd983e47ecbf0dbfe92)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:49.766745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:49.779673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 166/330] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Sep 3 20:32:49 2022] PUT /identity/v3/system/users/7ec1178f42ba4499a9b27c477cc1c003/roles/535025a1e39c4dd983e47ecbf0dbfe92 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:49.983164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:50.029526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:50.092157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf16a32-096e-4dc7-bdc9-66162c1af6a2 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:50.127780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:50.128765 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:50.129219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:50.129612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:50.141132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:50.146168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:50.147237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:50.148190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:50.150490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 165/331] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:50.156170 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:50.308337 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91c5a9-dc29-4b7a-9fec-47e81a77acd3 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:50.359108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:50.359742 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:50.360047 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:50.360278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:50.360986 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:50.361290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:50.362688 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:50.377092 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 167/332] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:50.383135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:50.528516 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618bdb9-d9d4-499d-abcc-cd33f5152e92 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:50.530285 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:50.582931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f8dec-2f13-4630-ad37-2196136e186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:50.583586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f8dec-2f13-4630-ad37-2196136e186b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:50.583862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f8dec-2f13-4630-ad37-2196136e186b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:50.584132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f8dec-2f13-4630-ad37-2196136e186b None admin] PATH_INFO: `/v3/users/75bfa1bb0486445b8b236a2d912729ff` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:50.585499 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f8dec-2f13-4630-ad37-2196136e186b None admin] RBAC: Authorizing `identity:get_user(user_id=75bfa1bb0486445b8b236a2d912729ff)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:50.586896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f8dec-2f13-4630-ad37-2196136e186b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:50.589003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 166/333] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:50 2022] GET /identity/v3/users/75bfa1bb0486445b8b236a2d912729ff => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:50.595003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:50.666560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:50.727875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca733041-e303-43bd-a730-095d9d0063e1 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:50.768021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:50.768650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:50.768955 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:50.769232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:50.769977 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] RBAC: Adding query filter params (role.id=cc1e3f9326fe428799f18f2167cad262, user.id=75bfa1bb0486445b8b236a2d912729ff, scope.system=all) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:50.770281 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:50.772699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94dd56-28ed-4a71-8728-5f13084bac1b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:50.785367 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 168/334] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 3 20:32:50 2022] GET /identity/v3/role_assignments?user.id=75bfa1bb0486445b8b236a2d912729ff&scope.system=all&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:52.041081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f300df-00bc-4e02-b9d8-a05bce4dbc80 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.041643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f300df-00bc-4e02-b9d8-a05bce4dbc80 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.041643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f300df-00bc-4e02-b9d8-a05bce4dbc80 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.043048 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 167/335] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:52.048946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaec4-f842-4a9f-91f5-db75c02228d8 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.049460 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaec4-f842-4a9f-91f5-db75c02228d8 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.049693 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaec4-f842-4a9f-91f5-db75c02228d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.070287 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6bcbaec4-f842-4a9f-91f5-db75c02228d8 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:52.071487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6bcbaec4-f842-4a9f-91f5-db75c02228d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:52.163021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:52.383283 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69324-e5bd-42e1-a37d-ba751729e2d5 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.383809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69324-e5bd-42e1-a37d-ba751729e2d5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.384250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc69324-e5bd-42e1-a37d-ba751729e2d5 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.386022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 168/337] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:52.392168 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.392443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.392712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.417796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:52.418981 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:52.450681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:52.494549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:52.575584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc69324-e5bd-42e1-a37d-ba751729e2d5 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:52.695642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc69324-e5bd-42e1-a37d-ba751729e2d5 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:52.740583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a278054-b658-41e6-b3b9-b97d024b2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:52.741677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278054-b658-41e6-b3b9-b97d024b2c06 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.742165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278054-b658-41e6-b3b9-b97d024b2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.742638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a278054-b658-41e6-b3b9-b97d024b2c06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.761811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a278054-b658-41e6-b3b9-b97d024b2c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-7a278054-b658-41e6-b3b9-b97d024b2c06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:52.767098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:52.768026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:52.768985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 169/339] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:52.776601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:52.868779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997787-a10a-4c14-8ba5-79718a779c98 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.869167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997787-a10a-4c14-8ba5-79718a779c98 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.869360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61997787-a10a-4c14-8ba5-79718a779c98 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.870716 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 170/340] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:52.876214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.876492 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.876760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.904715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:52.907364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:52.914053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13abcb8-ce9a-4d09-be03-bb9b0516eab5 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:52.959968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:52.972536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:52.973185 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:52.973513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:52.973785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:52.974560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:52.974861 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:52.976467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:52.987491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 171/341] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:52.993894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.041638 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:53.054444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 171/342] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:32:53.055473 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.193678 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f9e10-918f-412e-8198-019d676e1e8d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:53.250723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6b4e7-a979-4f40-8688-9cc73058e8eb None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:53.258930 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:53.259906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:53.260390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:53.260888 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:53.293972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:53.294987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:53.295428 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:53.295945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:53.309314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:53.315546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:53.316455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:53.318075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:53.320187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 172/343] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:53.325949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.355175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:53.390215 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:53.391699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:53.443243 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:53.503717 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1230f-70ea-4b90-8ea8-53d036976ab6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:53.543854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 172/344] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:53.546386 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.582094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:53.582657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:53.582930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:53.583197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:53.583966 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:53.584150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:53.585767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:53.604693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 173/345] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:53.605578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.665258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bda37b-4285-4ed7-a25c-760a7efb7d63 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:53.695351 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:53.705562 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:53.706569 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:53.707094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:53.707537 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:53.708926 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:53.710895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:53.716112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 173/346] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:53 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:53.717273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.810074 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:53.830838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8a4d-90db-4801-a3dc-308dd17f1c2b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:53.849354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3f78a-9731-4152-9e94-1ad815088506 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:53.869692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2676b1-2adc-43ae-a4b1-d4936e86343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:53.870790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2676b1-2adc-43ae-a4b1-d4936e86343b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:53.871284 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2676b1-2adc-43ae-a4b1-d4936e86343b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:53.871732 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2676b1-2adc-43ae-a4b1-d4936e86343b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:53.884729 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:53.885692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:53.885827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:53.886142 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:53.897432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:53.902874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:53.903908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:53.904967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 174/347] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:53.909684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:53.945366 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:53.955101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2676b1-2adc-43ae-a4b1-d4936e86343b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:53.956908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2676b1-2adc-43ae-a4b1-d4936e86343b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.017034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690920d-0e67-45c4-8e53-c13653dcbbed None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.052936 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f01c97-212f-4dab-9de4-b73b27b3bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.053712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01c97-212f-4dab-9de4-b73b27b3bdbe None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.054057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01c97-212f-4dab-9de4-b73b27b3bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.054401 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01c97-212f-4dab-9de4-b73b27b3bdbe None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.060796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f01c97-212f-4dab-9de4-b73b27b3bdbe None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.062323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f01c97-212f-4dab-9de4-b73b27b3bdbe None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.066405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 175/348] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:53 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:54.066405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54e60-b08b-4078-a21c-3e2ca6cddb91 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.066620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54e60-b08b-4078-a21c-3e2ca6cddb91 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.066923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae54e60-b08b-4078-a21c-3e2ca6cddb91 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.068453 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 176/349] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:54.074156 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae54e60-b08b-4078-a21c-3e2ca6cddb91 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.075669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 174/350] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:54.077419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.077879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.078365 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.088079 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.103141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:54.104826 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:54.200804 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 175/351] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:54.201540 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae54e60-b08b-4078-a21c-3e2ca6cddb91 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.202720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.232692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.238065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.238541 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.238894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.239235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.240003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:54.240449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.241924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.251332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 177/352] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:54.258830 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.322949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb84c86-cc7a-462f-a6d3-073c45d25f5d None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.332046 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.365345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.366490 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.367451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.367930 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.368550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ce650-6368-4287-aa31-ace9b2bc56d9 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.369703 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.371722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.374147 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 176/353] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:54.375391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.410756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.411387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.411673 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.412344 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.413173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=95075c2c580f4f1894bbaa9d34591719) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:54.413506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.414992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.425876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 178/354] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:54.425876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.510612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.520532 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389232a-d0e2-4672-aafa-5862c0e3c4f9 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.539573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd26bf-bf5c-456c-adaa-28e43d743304 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.569612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.570655 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.571125 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.571704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] PATH_INFO: `/v3/users/7ec1178f42ba4499a9b27c477cc1c003` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.572339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.576024 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] RBAC: Authorizing `identity:get_user(user_id=7ec1178f42ba4499a9b27c477cc1c003)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.576937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.577242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.577896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.578172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.578444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.579573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.580817 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 177/355] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/users/7ec1178f42ba4499a9b27c477cc1c003 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:54.583130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.587097 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.589202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 179/356] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:54.590815 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:54.730344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc35abe-e6d8-434b-9866-0b73de636632 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.737420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8bab7-c09b-4322-b76f-9f6352cb129a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:54.777797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.778400 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.778675 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.778941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.779776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] RBAC: Adding query filter params (role.id=535025a1e39c4dd983e47ecbf0dbfe92, user.id=7ec1178f42ba4499a9b27c477cc1c003, scope.system=all) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:54.780091 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.781774 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985204d-04e7-441b-b79f-f8297c40dcd9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.783349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:54.784201 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.784687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.785191 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.786171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=95075c2c580f4f1894bbaa9d34591719) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:54.786715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:54.788484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b70f4-537a-40ef-a773-5495e5466d6f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:54.795104 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 180/357] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:54.797314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3be26-e373-4d8f-936c-c53f63dad4fb None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.797795 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3be26-e373-4d8f-936c-c53f63dad4fb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.798258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3be26-e373-4d8f-936c-c53f63dad4fb None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.799769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 181/358] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:54.801302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246c7b-b94e-4bae-8c46-0cec2c962bdb None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.801829 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246c7b-b94e-4bae-8c46-0cec2c962bdb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.802349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246c7b-b94e-4bae-8c46-0cec2c962bdb None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.803790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 178/359] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/role_assignments?user.id=7ec1178f42ba4499a9b27c477cc1c003&scope.system=all&role.id=535025a1e39c4dd983e47ecbf0dbfe92 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:54.804067 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 182/360] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:54.810104 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.810463 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.810662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.815644 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:54.816259 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:54.816740 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:54.856873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:54.856873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:54.858522 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:54.859965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:54.888141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.951200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:54.970163 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 183/361] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:54.971070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.058540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 179/362] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:55.144045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef979a7-05ac-41a1-a86f-2e8e02f120c4 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.181445 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:55.182456 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:55.182920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:55.183402 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:55.194867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:55.200002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:55.200890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:55.201715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:55.204341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 184/363] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:55.210018 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.333230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4d3c6-4673-46d9-8f2c-d40c20be90bb None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.375200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:55.376198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:55.376672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:55.377198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:55.378121 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:55.378605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:55.380207 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:55.391608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 180/364] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:55.397997 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.419082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.443323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:55.467393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:55.517219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2cd4-459d-4924-aa49-0385741b2dd7 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.560030 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:55.560946 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:55.561509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:55.561509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:55.575452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7616f-ff87-44c8-8d23-521a00cf3c21 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.613610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:55.614305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:55.614585 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:55.614857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:55.627944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:55.633689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:55.634616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:32:55.635441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:55.640741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 181/365] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:32:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:32:55.641634 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.647373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:55.649083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:55.721172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:55.736662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:55.774297 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ed1ad-81e9-4ca6-a453-d9e6fc75421e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.781206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 185/366] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:55.782506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.814348 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:55.814998 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:55.815634 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:55.815634 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:55.827886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:55.835180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:55.837417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 182/367] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:55.839343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:55.941403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a150e-2624-4c3b-bbd7-e7fb19ac3a30 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.951657 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804002a3-e0c3-416e-82e0-264c625d278b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:55.990247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:55.990932 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:55.991210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:55.991478 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:55.992152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:55.992450 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:55.993728 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:55.995202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.000999 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.001903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.002406 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.002881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.004192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.005870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.010652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 186/368] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:56.010652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.013175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 183/369] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:55 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:56.015264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.029130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:56.147476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb8224-0c58-41bc-a2fa-8c1a9b7be7ee None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:56.159849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cdf39-04b9-46f5-97b1-959a2c57f69b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:56.197653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.198611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.199083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.199569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.200442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:56.200996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.202587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.208827 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.209947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.210429 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.211376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.216258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 187/370] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:56.221369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.305429 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:56.307652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.309701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.332788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:56.359760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b23e1e-5629-4249-b099-5b51c9d9da8b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:56.400066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.401187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.401662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.402144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.403585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.405272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.407074 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 188/371] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:56.408177 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.436869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 184/372] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:32:56.436869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.531663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c631aa-43bd-4731-87fc-fa5b115a4a4d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:56.566001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:56.569552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db227b62-82fe-489f-bdde-ebacbf62dc50 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:56.585227 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.590688 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.591471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.591986 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.618778 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:56.626069 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.627190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.627931 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.628601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.630159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:56.630905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.633699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.641286 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 185/373] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:56.642457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.693705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.696004 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.810223 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca54e5-429c-430d-86c9-3777946f5802 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:56.865603 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:56.866319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:56.866598 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:56.866869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] PATH_INFO: `/v3/projects/62e71242b6cf459c81a02ac25c62a69e` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:56.868059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=62e71242b6cf459c81a02ac25c62a69e)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:56.869588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:56.871292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 186/374] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/projects/62e71242b6cf459c81a02ac25c62a69e => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:56.877776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.899677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 189/375] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:32:56.909051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:56.935275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:56.975294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:57.021377 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7648f-d77f-4359-841a-9ac34ab2e3c2 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:57.056425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d514991-03d5-4e2e-a78b-4a3ce2fb77d5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:57.077123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:57.077683 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.077958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.078227 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] PATH_INFO: `/v3/groups/cece4e18dd694b43a5757a9ae577cfa7` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.095552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] RBAC: Authorizing `identity:get_group(group_id=cece4e18dd694b43a5757a9ae577cfa7)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:57.097067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:57.099028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 187/376] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/groups/cece4e18dd694b43a5757a9ae577cfa7 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:57.103032 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:57.103757 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.104103 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.104445 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.105760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:57.106416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:57.107309 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:57.111593 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 190/377] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:56 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:57.118476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:57.222100 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:57.227865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c8329-a1e0-4e4d-b529-b35da9ba4fd5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:57.269826 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:57.270443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.270713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.270976 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.271700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] RBAC: Adding query filter params (group.id=cece4e18dd694b43a5757a9ae577cfa7, role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=62e71242b6cf459c81a02ac25c62a69e) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:57.272005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:57.273544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b2de4-6163-442b-bb63-015de1daf12b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:57.285775 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 188/378] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:32:57 2022] GET /identity/v3/role_assignments?group.id=cece4e18dd694b43a5757a9ae577cfa7&scope.project.id=62e71242b6cf459c81a02ac25c62a69e&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:57.325420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b873fd-5eef-4820-9796-26e6866c3a4d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:57.341949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:57.360941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e379f5-88d6-4968-b41b-6031655661ba None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.361247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e379f5-88d6-4968-b41b-6031655661ba None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.361487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e379f5-88d6-4968-b41b-6031655661ba None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.362849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 189/379] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:32:57.368563 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c79b-ffc5-425f-a4f9-1830770f2d7a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.369158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c79b-ffc5-425f-a4f9-1830770f2d7a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.369658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c79b-ffc5-425f-a4f9-1830770f2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.374761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:57.375374 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.375649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.376958 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.380978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:57.385427 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:57.390145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 191/380] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:57 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:57.395006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6000c79b-ffc5-425f-a4f9-1830770f2d7a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:57.396230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6000c79b-ffc5-425f-a4f9-1830770f2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:57.401222 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:57.542536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 190/381] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:57.580045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f1360-30ae-43cc-bb69-48ec9fe51e88 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:57.622456 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:57.622997 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.623276 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.623612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.624362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:57.624756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:57.626353 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bde4ff-1d4f-4c30-9b71-cf8ab0008e80 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:57.640875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 192/382] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:32:57 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:57.724208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d4f43-23d1-4c1e-8d9b-fe717d21d1f6 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.724886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d4f43-23d1-4c1e-8d9b-fe717d21d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.725453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d4f43-23d1-4c1e-8d9b-fe717d21d1f6 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.727524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 191/383] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:57.733119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:57.733413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:57.733662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:57.766236 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:57.767461 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:57.828568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:57.862837 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 193/384] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:32:58.023593 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d4f43-23d1-4c1e-8d9b-fe717d21d1f6 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.139305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:58.153370 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d4f43-23d1-4c1e-8d9b-fe717d21d1f6 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:58.208229 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.211971 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:58.212628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:58.212926 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:58.213197 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:58.237297 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:58.243328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:58.244232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:32:58.245050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 192/385] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:58.252216 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.379660 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14eb7f-8e30-4afd-8b53-fe97c88b0cca None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:58.423721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:58.424362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:58.424634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:58.424960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:58.436666 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:32:58.445355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:32:58.446292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:32:58.447475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 194/386] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:32:58.453261 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.466919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf8e7-0043-430f-8e87-d4e8c3316193 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:58.515624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:58.561568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:58.563166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:58.563433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:58.563697 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:58.564364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:58.564659 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:58.566096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:58.583147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b4f42-b422-4af3-baae-a541b985f83b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:58.587852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 193/387] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:58.593402 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.618634 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:58.653146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:58.653677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:58.653949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:58.654211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:58.656949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:32:58.662427 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:58.664100 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:58.679164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 195/388] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:58.684758 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.760024 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da248be-3cc9-4bf3-a98a-3f6135b95ab6 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:58.795631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:58.796272 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:58.796542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:58.796811 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:58.797974 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:58.799618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:58.801539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 194/389] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:58.807153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.828049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:58.834097 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ee690-9783-48e2-9369-642e3ce87aa4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:58.878198 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:58.879317 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:58.880263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:58.880725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:58.882187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:58.884709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:58.886993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 196/390] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:32:58.892438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:58.937781 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:58.991193 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506de56-ea6f-453f-828b-17b24d1d74a3 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:59.015762 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d580f-8efa-40da-8669-cf826217d8b9 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:59.056581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:59.057632 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:59.058101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:59.058590 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:59.060001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:59.061882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:59.065262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 197/391] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:59.071660 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:59.074557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:59.075222 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:59.075500 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:59.075966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:59.078143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:59.078946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:59.085205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 195/392] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:32:58 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:32:59.087419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:32:59.134038 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:59.220594 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd6ce-982b-4aac-a524-042a4139c275 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:59.257460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180fc52-8448-4c82-948a-b42af647710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:59.258604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180fc52-8448-4c82-948a-b42af647710f None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:59.259071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180fc52-8448-4c82-948a-b42af647710f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:59.259530 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180fc52-8448-4c82-948a-b42af647710f None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719/groups/5f450a9a201c4b25912a70dadec6daf2/roles/0c3434548fa045d9a248a23fd0a93fa4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:59.262955 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180fc52-8448-4c82-948a-b42af647710f None admin] RBAC: Authorizing `identity:create_grant(project_id=95075c2c580f4f1894bbaa9d34591719, group_id=5f450a9a201c4b25912a70dadec6daf2, role_id=0c3434548fa045d9a248a23fd0a93fa4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:59.264683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180fc52-8448-4c82-948a-b42af647710f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:59.289485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 198/393] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 3 20:32:59 2022] PUT /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719/groups/5f450a9a201c4b25912a70dadec6daf2/roles/0c3434548fa045d9a248a23fd0a93fa4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:59.304204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230b1f-5d00-4c9a-af88-0b474e441aac None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:32:59.343188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92d7ed-53de-4d17-afb6-52f72830f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:32:59.344275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d7ed-53de-4d17-afb6-52f72830f421 None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:59.344742 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d7ed-53de-4d17-afb6-52f72830f421 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:59.345235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d7ed-53de-4d17-afb6-52f72830f421 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719/groups/5f450a9a201c4b25912a70dadec6daf2/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:59.347436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92d7ed-53de-4d17-afb6-52f72830f421 None admin] RBAC: Authorizing `identity:create_grant(project_id=95075c2c580f4f1894bbaa9d34591719, group_id=5f450a9a201c4b25912a70dadec6daf2, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:32:59.349128 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92d7ed-53de-4d17-afb6-52f72830f421 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:32:59.369594 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 196/394] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 3 20:32:59 2022] PUT /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719/groups/5f450a9a201c4b25912a70dadec6daf2/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:32:59.870174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5adeb-27fd-4333-9858-b9d5541f61f5 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:59.871300 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5adeb-27fd-4333-9858-b9d5541f61f5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:59.871774 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5adeb-27fd-4333-9858-b9d5541f61f5 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:59.873579 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 199/395] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:32:59.879928 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607d3f-469d-4a05-9217-edce339c04ad None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:32:59.880461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607d3f-469d-4a05-9217-edce339c04ad None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:32:59.880949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607d3f-469d-4a05-9217-edce339c04ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:32:59.901053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-c8607d3f-469d-4a05-9217-edce339c04ad None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:32:59.902635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-c8607d3f-469d-4a05-9217-edce339c04ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:32:59.905018 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:32:59.978051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 197/396] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:00.330474 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af744812-b808-436f-aac6-4dae0cea4f3e None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:00.331178 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af744812-b808-436f-aac6-4dae0cea4f3e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:00.331645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af744812-b808-436f-aac6-4dae0cea4f3e None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:00.333495 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 200/397] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:00.338411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af744812-b808-436f-aac6-4dae0cea4f3e None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:00.339283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75127b-6ceb-4957-962b-1b74d31a655e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:00.340095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75127b-6ceb-4957-962b-1b74d31a655e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:00.340554 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75127b-6ceb-4957-962b-1b74d31a655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:00.372443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9d75127b-6ceb-4957-962b-1b74d31a655e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:00.374543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9d75127b-6ceb-4957-962b-1b74d31a655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:00.469356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:00.476909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 198/398] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:00.476909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e926-c873-4ca8-8e47-2072d6819e4f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:00.476909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e926-c873-4ca8-8e47-2072d6819e4f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:00.476909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6e926-c873-4ca8-8e47-2072d6819e4f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:00.477865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 199/399] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:00.479705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af744812-b808-436f-aac6-4dae0cea4f3e None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:00.484052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:00.484533 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:00.485019 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:00.510266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:00.511771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:00.565823 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:00.566643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:00.566960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:00.567302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:00.584230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:00.591297 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 200/400] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:00.609669 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:00.614509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:00.615383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:00.616273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 201/401] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:00.621528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:00.750755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dc6e5-3db7-497b-bd35-12a0e9fc247b None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:00.791046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:00.791661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:00.791936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:00.792203 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:00.792887 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] RBAC: Adding query filter params (name=member) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:00.793190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:00.794566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:00.808694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 201/402] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:00.814687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:00.933881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:00.957529 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01f796-c936-49f6-af10-4bc92b0300e2 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.006734 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.007294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.007566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.008682 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.010872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.015638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.018500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 202/403] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:00 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.023098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.024948 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.061193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.094570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a32c2-1a0b-4a92-9af0-6c1c26d9ec59 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.146136 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ff72-36e5-472d-a589-e668a0277607 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.157797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.158782 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.159248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.159773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.176026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:01.182639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.183306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.183583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.183855 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.185116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:01.186499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:01.187376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:33:01.188209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:01.188816 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.188816 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 203/404] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.190533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.191234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 202/405] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:01.197317 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.294144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.306205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226f8e0-9d89-4e8a-bd2e-1cf1f8285772 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.307436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543bfec-ceb7-4f44-bfa2-3e53b14b0e15 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.327486 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.342336 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.343083 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.343452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.343812 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.344563 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:01.344998 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.346184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.346567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.347127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.347561 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.348071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.355833 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 203/406] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.356860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.360248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:01.366019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:01.366909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:01.367711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:01.370392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 204/407] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:01.371458 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.458039 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb39d1-6d53-42f4-8245-2708d38512ad None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.481050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adb587-8aa5-4533-9be2-b6e7f576f5f3 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.492395 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.493256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.493535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.493803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/groups/5f450a9a201c4b25912a70dadec6daf2/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.495698 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1bb4b1128489e93c1636c7cb2148a, group_id=5f450a9a201c4b25912a70dadec6daf2, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.497179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.516541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 204/408] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 3 20:33:01 2022] PUT /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/groups/5f450a9a201c4b25912a70dadec6daf2/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:01.517935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.524092 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.525179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.525657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.526171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.527812 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.532935 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.540779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 205/409] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.546558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.581536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.594633 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.653312 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2694ce-fa37-4971-b802-458dd8fdef6e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.719379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.720388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.720880 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.721369 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.722257 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:01.722816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.724595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.745273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 205/410] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.750942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.784844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2e495-df26-47b7-bbbf-f1a8ef6ee94a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.839050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.839050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.839050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.839369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.840545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.842663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.845878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 206/411] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.853660 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.900488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7114690e-76f8-4f95-bb97-3f4dbaf107b3 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:01.905228 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.967237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:01.969945 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:01.970613 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:01.970899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:01.971294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] PATH_INFO: `/v3/groups/cece4e18dd694b43a5757a9ae577cfa7` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:01.972529 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] RBAC: Authorizing `identity:get_group(group_id=cece4e18dd694b43a5757a9ae577cfa7)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:01.976631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:01.979315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 206/412] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/groups/cece4e18dd694b43a5757a9ae577cfa7 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:01.983903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:01.988819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45ebac-89b9-4a53-86e7-f965f7bea2b6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:02.028577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:02.029702 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.030204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.030710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/groups/5f450a9a201c4b25912a70dadec6daf2/roles/0c3434548fa045d9a248a23fd0a93fa4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.033292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] RBAC: Authorizing `identity:create_grant(project_id=a3e1bb4b1128489e93c1636c7cb2148a, group_id=5f450a9a201c4b25912a70dadec6daf2, role_id=0c3434548fa045d9a248a23fd0a93fa4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:02.035129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:02.056912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 207/413] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 3 20:33:01 2022] PUT /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a/groups/5f450a9a201c4b25912a70dadec6daf2/roles/0c3434548fa045d9a248a23fd0a93fa4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:33:02.163194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6800f1-588b-4ebc-9389-04e66c8251d7 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:02.201397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbd96f-6c19-444d-9d52-bbebbece89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:02.202060 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbd96f-6c19-444d-9d52-bbebbece89ab None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.202338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbd96f-6c19-444d-9d52-bbebbece89ab None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.202609 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbd96f-6c19-444d-9d52-bbebbece89ab None admin] PATH_INFO: `/v3/projects/62e71242b6cf459c81a02ac25c62a69e` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.203771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbd96f-6c19-444d-9d52-bbebbece89ab None admin] RBAC: Authorizing `identity:get_project(project_id=62e71242b6cf459c81a02ac25c62a69e)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:02.205751 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbd96f-6c19-444d-9d52-bbebbece89ab None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:02.207880 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 207/414] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:01 2022] GET /identity/v3/projects/62e71242b6cf459c81a02ac25c62a69e => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:02.213993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:02.221588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebae65f-a651-446d-b4fc-7b7109440e68 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.221955 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebae65f-a651-446d-b4fc-7b7109440e68 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.222295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebae65f-a651-446d-b4fc-7b7109440e68 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.226251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 208/415] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:02.230344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9eb4-ae68-482e-864b-95d137bc8366 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.230644 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9eb4-ae68-482e-864b-95d137bc8366 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.230987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a9eb4-ae68-482e-864b-95d137bc8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.254295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-8a7a9eb4-ae68-482e-864b-95d137bc8366 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:02.258510 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-8a7a9eb4-ae68-482e-864b-95d137bc8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:02.323652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:02.370385 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 209/416] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:02.399988 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9049ae-b87a-43bf-8bc3-0cc35bcb81cb None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:02.425376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cef6-a261-4724-ad4b-67cbd819a8b0 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.425683 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cef6-a261-4724-ad4b-67cbd819a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.425914 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50cef6-a261-4724-ad4b-67cbd819a8b0 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.427491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 210/417] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:02.432522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.432802 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.433112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.437125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:02.437999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.438417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.438831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] PATH_INFO: `/v3/projects/62e71242b6cf459c81a02ac25c62a69e/groups/cece4e18dd694b43a5757a9ae577cfa7/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.445600 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e71242b6cf459c81a02ac25c62a69e, group_id=cece4e18dd694b43a5757a9ae577cfa7, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:02.447901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:02.458282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:02.458282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:02.482981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 208/418] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Sep 3 20:33:02 2022] PUT /identity/v3/projects/62e71242b6cf459c81a02ac25c62a69e/groups/cece4e18dd694b43a5757a9ae577cfa7/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:02.554261 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 211/419] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:02.716790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:02.726789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:02.842620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0c614-6f5d-419c-abf6-0d44803ba179 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:02.879126 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:02.879753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:02.880025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:02.880286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:02.891800 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:02.897403 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:02.898327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:02.899129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 209/420] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:02.905017 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.026499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:03.032243 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816fc8-ff6a-4ba5-8ef4-2b79fa8cf948 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:03.083900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:03.084997 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:03.085497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:03.085961 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:03.086870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:03.087434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:03.089039 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:03.097943 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 212/421] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:03.104082 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.105578 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.208734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbf163-4988-4027-aac4-5b7f8a8dd526 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:03.258132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:03.275420 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:03.276231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:03.276665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:03.276995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:03.324013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f83a4a-4c23-473c-baed-a253883a69ba None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:03.333208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:03.388282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:03.388968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:03.389248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:03.389517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:03.406984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:03.408465 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:03.415865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:03.421157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:03.422039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:03.422825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 210/422] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:03.435604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.612104 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9557e-9136-412f-8320-975e191c1149 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:03.619486 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 213/423] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:03.625800 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.655703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:03.672871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:03.673535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:03.673813 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:03.674090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:03.674791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:03.675090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:03.676485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:03.699096 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 211/424] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:03.714896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.758704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:03.802168 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd657ed-4325-41bc-9c6e-f6d764d2e011 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:03.838889 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:03.839523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:03.839917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:03.840117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:03.841269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:03.843196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:03.844642 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 214/425] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:03 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:03.857816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:03.878369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697e8bc-a39a-42db-9309-8192ce560a4a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:03.932377 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86998036-bd77-40dd-b612-8ba76ee56de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:03.933273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86998036-bd77-40dd-b612-8ba76ee56de7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:03.933684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86998036-bd77-40dd-b612-8ba76ee56de7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:03.934087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86998036-bd77-40dd-b612-8ba76ee56de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.041225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:04.060805 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86998036-bd77-40dd-b612-8ba76ee56de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:04.063237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86998036-bd77-40dd-b612-8ba76ee56de7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:04.074612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751165f4-4360-4a0b-9c72-43ef3bc27407 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:04.137498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:04.149316 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:04.149962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.150243 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.150515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.151741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:04.153407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:04.164405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 215/426] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:03 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:04.174295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:04.208185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 212/427] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:33:04.210297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da88f-87f7-4656-af7e-5758a1e269cc None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.210724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da88f-87f7-4656-af7e-5758a1e269cc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.211152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694da88f-87f7-4656-af7e-5758a1e269cc None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.213165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 213/428] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:04.214122 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da88f-87f7-4656-af7e-5758a1e269cc None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:04.298333 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e842c-18d8-474c-9add-c098c61319fb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:04.309279 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:04.324954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694da88f-87f7-4656-af7e-5758a1e269cc None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:04.339647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:04.340679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.341254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.341716 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.342890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=95075c2c580f4f1894bbaa9d34591719) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:04.343495 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:04.345139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee826-15be-463e-af47-a2faa8e30121 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:04.352767 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 216/429] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:33:04 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:04.354125 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.354570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.354982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.373916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:04.374742 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.375020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.375288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] PATH_INFO: `/v3/projects/95075c2c580f4f1894bbaa9d34591719` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.376332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:04.376449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] RBAC: Authorizing `identity:get_project(project_id=95075c2c580f4f1894bbaa9d34591719)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:04.377919 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:04.378164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:04.380044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 214/430] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:04 2022] GET /identity/v3/projects/95075c2c580f4f1894bbaa9d34591719 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:04.385940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:04.447299 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:04.461014 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 217/431] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:04.555458 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8af6-a4ed-4364-9afa-76ed574309e4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:04.606619 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54ff41-c1bf-40ca-a901-6c1d86bd9e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:04.607576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54ff41-c1bf-40ca-a901-6c1d86bd9e4e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.607999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54ff41-c1bf-40ca-a901-6c1d86bd9e4e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.608408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54ff41-c1bf-40ca-a901-6c1d86bd9e4e None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.609756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54ff41-c1bf-40ca-a901-6c1d86bd9e4e None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:04.611446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54ff41-c1bf-40ca-a901-6c1d86bd9e4e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:04.613662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 215/432] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:04 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:04.620439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:04.643809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929a838-ca38-42cc-adcd-7c7c512c2fda None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.644314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929a838-ca38-42cc-adcd-7c7c512c2fda None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.644589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929a838-ca38-42cc-adcd-7c7c512c2fda None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.646226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 216/433] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:33:04.651543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.651817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.652086 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.677067 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:04.678281 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:04.707218 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:04.769710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd6a9a-174b-496b-8e65-ab57d9c88d47 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:04.777488 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 217/434] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:04.807756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:04.808380 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:04.808655 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:04.808969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:04.809704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=95075c2c580f4f1894bbaa9d34591719) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:04.810009 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:04.811452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:04.818324 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 218/435] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:33:04 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=95075c2c580f4f1894bbaa9d34591719&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:04.953924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.062012 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c49f687-293a-4bb2-9e12-10c8296e0393 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.099769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.100468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.100745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.101226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.112234 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:05.117505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:05.118408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:05.119221 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 218/436] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:05.126905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.130597 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.154383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.207575 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.272676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4f6bf-4ea9-4150-9262-4bb358b401b7 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.275992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f7843-6557-4c92-8949-c93314cfd731 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.318699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b586-cfa6-483a-8a20-cd799984bf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.319050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b586-cfa6-483a-8a20-cd799984bf34 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.319247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b586-cfa6-483a-8a20-cd799984bf34 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.319643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b586-cfa6-483a-8a20-cd799984bf34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.321743 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.322187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.322462 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.322725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.325655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:05.325655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:05.325655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4b0fe-9146-4eec-b772-ea7ea055f8e8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:05.333857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b586-cfa6-483a-8a20-cd799984bf34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:05.338292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 219/437] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-cf81b586-cfa6-483a-8a20-cd799984bf34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:05.340141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:05.341063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 20:33:05.341854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:05.342524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d384d2-866e-4d61-871b-ace187affc4e None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.342524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d384d2-866e-4d61-871b-ace187affc4e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.342524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d384d2-866e-4d61-871b-ace187affc4e None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.343235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 220/438] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:33:05.343926 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d384d2-866e-4d61-871b-ace187affc4e None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.344666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 219/439] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:05.348196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.348480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.348752 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.367683 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:05.368903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:05.441000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.451819 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 220/440] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:05.453356 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.471722 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d384d2-866e-4d61-871b-ace187affc4e None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.514418 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.515468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.515740 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.516006 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.526039 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.591939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:05.593497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:05.594358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddc508-a53b-422e-a3e1-bd036abc6e5f None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.632945 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.633944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.634217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.634484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.635145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:05.635442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:05.637196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:05.646236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 221/441] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:05.652470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.677471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.708402 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 221/442] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:05.709478 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.780818 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985576b-a7be-44a1-8828-aa8b7efce970 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.790770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.816692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807df08a-f131-4e16-8301-fd8c9bd868ac None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.818508 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.819161 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.819436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.819707 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.851090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.851732 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.852010 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.852278 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:05.853440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:05.854882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:05.856522 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 222/443] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:05.857344 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.888435 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:05.890280 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:05.903292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:05.957191 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac790f1-1c21-4eea-a822-4d7a6e8a98bd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:05.989769 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 222/444] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 20:33:05.990471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:05.990858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:05.991497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:05.991828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:05.992150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.002627 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:06.004439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:06.007945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:06.008934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:06.009788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 223/445] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:06.010580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.104624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a540f-5d82-4da9-9312-e924d4593a8b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.111130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df43654-f5d5-4eee-b91f-eb2637843e0c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.113467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.144453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.145163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.145442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.145714 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.146598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.146808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.147267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.147535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.147804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] PATH_INFO: `/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.148358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.148949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] RBAC: Authorizing `identity:get_project(project_id=a3e1bb4b1128489e93c1636c7cb2148a)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.149971 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 223/446] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:05 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:06.150394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.150728 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.156572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 224/447] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/projects/a3e1bb4b1128489e93c1636c7cb2148a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:06.156572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.229460 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.254220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab71af0-5c88-4b5f-916c-2b2b05bb382f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.255893 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f72d78-a9b4-45f5-9fb3-7d204820b91c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.288076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.288730 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.289033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.289296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.290010 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=cc1e3f9326fe428799f18f2167cad262, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:06.290310 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.291748 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.292079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.292689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.293034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.293471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.295276 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:06.295584 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.297082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.298315 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 225/448] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=cc1e3f9326fe428799f18f2167cad262 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:06.298991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.308124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 224/449] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:06.319647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.339407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.417185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15f538-44e0-4443-9a9c-d19c5a45d97a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.435058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66c4c1-9602-4a7c-9493-92edeaeb9e39 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.460441 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.461125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.461408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.461674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] PATH_INFO: `/v3/groups/5f450a9a201c4b25912a70dadec6daf2` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.462913 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] RBAC: Authorizing `identity:get_group(group_id=5f450a9a201c4b25912a70dadec6daf2)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.464390 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.466214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 226/450] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/groups/5f450a9a201c4b25912a70dadec6daf2 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:06.472069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.473851 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.474473 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.474815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.475022 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.487816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.566763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.568236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.596486 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff4e2e-ad72-498a-b192-59786267cb6c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.598846 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.636065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.636948 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.637382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.637656 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.638390 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] RBAC: Adding query filter params (group.id=5f450a9a201c4b25912a70dadec6daf2, role.id=0c3434548fa045d9a248a23fd0a93fa4, scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:06.638697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.640485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.646937 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 227/451] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/role_assignments?group.id=5f450a9a201c4b25912a70dadec6daf2&scope.project.id=a3e1bb4b1128489e93c1636c7cb2148a&role.id=0c3434548fa045d9a248a23fd0a93fa4 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:06.690388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 225/452] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:06.696716 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.807468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67413f-fc31-46bf-9c24-2203a9a1daae None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:06.845680 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:06.845916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:06.846164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:06.846413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] PATH_INFO: `/v3/projects/62e71242b6cf459c81a02ac25c62a69e` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:06.847742 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] RBAC: Authorizing `identity:get_project(project_id=62e71242b6cf459c81a02ac25c62a69e)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:06.849327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:06.851792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 228/453] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/projects/62e71242b6cf459c81a02ac25c62a69e => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:06.857897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:06.903505 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:06.967983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6bacd-c20f-4ab8-8313-c05028837d0f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:07.004934 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0804f7d-812d-4e93-a558-9735789d8771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:07.005561 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804f7d-812d-4e93-a558-9735789d8771 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:07.005838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804f7d-812d-4e93-a558-9735789d8771 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:07.006103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0804f7d-812d-4e93-a558-9735789d8771 None admin] PATH_INFO: `/v3/groups/cece4e18dd694b43a5757a9ae577cfa7` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:07.007429 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804f7d-812d-4e93-a558-9735789d8771 None admin] RBAC: Authorizing `identity:get_group(group_id=cece4e18dd694b43a5757a9ae577cfa7)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:07.008964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0804f7d-812d-4e93-a558-9735789d8771 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:07.010542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 226/454] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Sep 3 20:33:06 2022] GET /identity/v3/groups/cece4e18dd694b43a5757a9ae577cfa7 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:07.016924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:07.052283 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:07.115953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302746a9-4da9-4306-8d62-c6c036d19d36 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:07.151874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:07.152480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:07.152758 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:07.153061 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:07.153779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] RBAC: Adding query filter params (group.id=cece4e18dd694b43a5757a9ae577cfa7, role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=62e71242b6cf459c81a02ac25c62a69e) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:07.154084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:07.155544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf33e4-42a3-4d92-900b-cf9175ab1f28 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:07.161288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 229/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Sep 3 20:33:07 2022] GET /identity/v3/role_assignments?group.id=cece4e18dd694b43a5757a9ae577cfa7&scope.project.id=62e71242b6cf459c81a02ac25c62a69e&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:09.673284 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c169-7fbd-4c0c-86e8-85ad703691fa None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:09.673820 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c169-7fbd-4c0c-86e8-85ad703691fa None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:09.674059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959c169-7fbd-4c0c-86e8-85ad703691fa None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:09.675774 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 227/456] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:09.681283 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15a8f-3213-4bd8-aa7c-0c3c8bd3e05a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:09.681731 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15a8f-3213-4bd8-aa7c-0c3c8bd3e05a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:09.682017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e15a8f-3213-4bd8-aa7c-0c3c8bd3e05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:09.700772 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a2e15a8f-3213-4bd8-aa7c-0c3c8bd3e05a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:09.702001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a2e15a8f-3213-4bd8-aa7c-0c3c8bd3e05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:09.771708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 230/457] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:09.821696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a118dc5-2fa3-4c80-b1f1-bb71818e2d8f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:09.822013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a118dc5-2fa3-4c80-b1f1-bb71818e2d8f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:09.822239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a118dc5-2fa3-4c80-b1f1-bb71818e2d8f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:09.823855 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 228/458] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:09.832405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4e38c-366b-46c7-bca9-4a601f809c89 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:09.832405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4e38c-366b-46c7-bca9-4a601f809c89 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:09.832405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4e38c-366b-46c7-bca9-4a601f809c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:09.850742 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-91c4e38c-366b-46c7-bca9-4a601f809c89 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:09.852233 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-91c4e38c-366b-46c7-bca9-4a601f809c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:09.880186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:09.924545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 231/459] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:10.031969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9df7-a699-4174-be2c-2a526c066fe7 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.032235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9df7-a699-4174-be2c-2a526c066fe7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.032633 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a9df7-a699-4174-be2c-2a526c066fe7 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.034420 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 229/460] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:10.040559 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.041040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.041481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.060044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:10.061484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:10.140864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9df7-a699-4174-be2c-2a526c066fe7 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.141088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 232/461] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:10.241877 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a9df7-a699-4174-be2c-2a526c066fe7 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.249469 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:10.275022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.277203 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.278007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.278282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.278647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.289943 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.291521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:10.308379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:10.309426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:10.310290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:10.310290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:10.310290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:10.310290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 230/462] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:10.316078 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.376888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:10.387821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd4137-b6eb-49cb-89c0-64417f1870a0 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.423889 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea58366-1e0b-4f5f-b698-5e81935a3cbb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.424196 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.424858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.425141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.425410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.437498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.438957 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-26bdad45-b91b-439b-8947-b23e5bd1e441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:10.453647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:10.454607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 233/463] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d297-a728-4068-b761-c1a41c0153d4 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d297-a728-4068-b761-c1a41c0153d4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345d297-a728-4068-b761-c1a41c0153d4 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.460412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 234/464] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:10.460901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345d297-a728-4068-b761-c1a41c0153d4 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.468863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.469492 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.469770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.470073 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.470684 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:10.470978 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.472452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d788699-5d5b-4183-ba53-592287664371 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.489307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 231/465] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:10.489307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.489307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.489307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.505189 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:10.506292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:10.519721 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:10.565069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345d297-a728-4068-b761-c1a41c0153d4 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.575677 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 232/466] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:10.576503 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.609882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.611563 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.612045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.612376 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.613401 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:10.613713 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.615162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.633803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 235/467] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:10.633803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.636507 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:10.683524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f17758-f9fe-417e-bac3-1baead852a54 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.718462 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.719418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.719700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.719963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.730954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.732406 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.742936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:10.750734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:10.751744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:10.752785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:10.752785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:10.752785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:10.754281 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 233/468] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:10.754841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.760517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e59b07-184f-4884-93ac-9cf56eaa2e06 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.795840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.796446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.796729 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.797034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.797700 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.799235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.828950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 236/469] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:33:10 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:10.829798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:10.886010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b45c1-40c0-4af3-ae6c-94b06a14fe30 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.910272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:10.939761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:10.940391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:10.940661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:10.940965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:10.941624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:10.943087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:10.961507 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e969b-e93b-40a2-8cca-79c3a108ef37 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:10.972868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 234/470] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:33:10 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:10.972868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:11.015630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:11.016643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:11.017230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:11.017502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:11.018183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:11.018485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:11.019918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:11.037822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 237/471] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:11.044016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:11.062629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:11.129072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b219-c8a4-4a1d-a943-db8e7a92b655 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:11.181566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:11.182859 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:11.183704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:11.183974 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:11.189845 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b712b46-4223-4c01-81d4-724e06397e4c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:11.199003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:11.200513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:11.211643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:11.220205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:11.221240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:11.222254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:11.222254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:11.222254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:11.222254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 235/472] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:11.228128 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:11.238692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:11.239527 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:11.239950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:11.240378 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:11.241066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:11.242777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:11.271790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 238/473] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:33:11 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:33:11.365343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b431550-2488-4396-8dc0-053bf1914234 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:11.376018 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:11.408622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:11.409280 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:11.409553 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:11.409821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:11.410470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:11.410766 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:11.412183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b891dad-5f26-4786-aa0b-874111ee6e1c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:11.427209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 236/474] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:11.432934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:11.545642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95bf6f-041b-4e49-85d1-e6ac5bcbf19a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:11.581132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d11fe-2765-44b9-bf55-3cc13c58e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:11.581750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d11fe-2765-44b9-bf55-3cc13c58e692 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:11.582030 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d11fe-2765-44b9-bf55-3cc13c58e692 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:11.582304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d11fe-2765-44b9-bf55-3cc13c58e692 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:11.582964 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d11fe-2765-44b9-bf55-3cc13c58e692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:11.584404 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d11fe-2765-44b9-bf55-3cc13c58e692 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:11.614323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 239/475] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:33:11 2022] POST /identity/v3/users => generated 249 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:13.246562 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de075f6-f84b-4236-8e70-94c7158e8b97 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.247113 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de075f6-f84b-4236-8e70-94c7158e8b97 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.247113 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de075f6-f84b-4236-8e70-94c7158e8b97 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.248755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 237/476] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:13.254271 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541405-0b36-4a76-8c1b-ce18709037d7 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.254671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541405-0b36-4a76-8c1b-ce18709037d7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.254824 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42541405-0b36-4a76-8c1b-ce18709037d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.274286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-42541405-0b36-4a76-8c1b-ce18709037d7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:13.275547 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-42541405-0b36-4a76-8c1b-ce18709037d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:13.300640 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:13.341153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4f77-779c-4848-a655-7cfd82cadbcc None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.341510 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4f77-779c-4848-a655-7cfd82cadbcc None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.341692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f4f77-779c-4848-a655-7cfd82cadbcc None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.343245 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 238/477] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:13.348321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31cce-c711-49a5-b037-a23b94baa129 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.348595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31cce-c711-49a5-b037-a23b94baa129 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.348892 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31cce-c711-49a5-b037-a23b94baa129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.352725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 240/478] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:13.366957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-76b31cce-c711-49a5-b037-a23b94baa129 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:13.368360 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-76b31cce-c711-49a5-b037-a23b94baa129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:13.438145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 239/479] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:13.605906 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d755-bdc6-43d0-b51f-9f09969fc79e None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.606538 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d755-bdc6-43d0-b51f-9f09969fc79e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.607032 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d755-bdc6-43d0-b51f-9f09969fc79e None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.608804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 241/480] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:13.614133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.614646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.615109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.634179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:13.635676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:13.684656 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9d755-bdc6-43d0-b51f-9f09969fc79e None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:13.707665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 240/481] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:13.767241 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:13.798710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:13.813871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9d755-bdc6-43d0-b51f-9f09969fc79e None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:13.853606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:13.854266 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.854544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.854816 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.866351 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:13.871325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:13.872240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:13.873070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:13.877529 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 242/482] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:13.878897 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:13.883669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ddc8-c090-4f42-9efb-c65642fc5eb7 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:13.902554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:13.922488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:13.923469 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:13.923973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:13.924431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:13.936032 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:13.941543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:13.942516 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:13.943315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:13.950645 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 241/483] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:13.951829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:13.986039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad91d9-04bf-40f3-b8f7-726044e18d81 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.023001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.023621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.023898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.024172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.024862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:14.025171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.026566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc476f2-ea59-421c-bc7f-e42b9a34e4b7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.035061 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 243/484] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:14.036309 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda2fe-acde-474d-a5d8-459a830052b1 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.036594 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda2fe-acde-474d-a5d8-459a830052b1 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.036892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda2fe-acde-474d-a5d8-459a830052b1 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.038235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 244/485] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:14.043053 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda2fe-acde-474d-a5d8-459a830052b1 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.053003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.066902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac895702-3f84-459b-8c29-3692da131f91 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.103115 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.103720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.103988 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.104257 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.104940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:14.105236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.106607 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c03a3-d232-4e4e-94a8-c14f84086352 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.114308 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 242/486] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:14.115400 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.115678 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.115938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.130285 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.133836 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:14.135010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:14.150480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda2fe-acde-474d-a5d8-459a830052b1 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.185406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.186041 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.186314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.186588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.197728 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.199175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.201849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 243/487] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:14.202692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:14.214416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:14.215341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:14.216211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:14.216211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:14.216211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:14.216211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 245/488] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:14.216874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.292901 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.313963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c5045-1443-4836-b208-cc0d851a1716 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.320506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4873ad3-4e51-45be-b138-165f8d72dce0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.351354 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.352472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.353012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.353367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.353507 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.354002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.354275 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.354538 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.356425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.367952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.369418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:14.369547 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:14.374260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:14.375137 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:14.375932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 244/489] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:14.376592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:14.389884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:14.391148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:14.392040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:14.392040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:14.392040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:14.392040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 246/490] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:14.392277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.488557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1792df-1af0-48b4-92e0-398b96c60f2a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.504709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5358f9-6b96-4169-a679-1e13498c8101 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.523725 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.524339 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.524614 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.524911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.525553 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:14.525852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.527225 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.535739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.539179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 245/491] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:14.540319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.545785 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.546373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.546654 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.546927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.547600 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:14.547901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.549335 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.557749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 247/492] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:14.558547 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.608983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.641051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08015f-40c1-4991-a56e-be634fa150b4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.660356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea999ae-7174-4dbf-b0e4-010814e5ffcd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.673945 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.674554 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.674829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.675097 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.675762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:14.676062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.677479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.689535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 246/493] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:14.690347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.692483 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.693272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.693551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.694510 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.704664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:14.711120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:14.712013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:14.712799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 248/494] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:14.713502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.750063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.790764 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ddf55b-224c-4509-826b-bc5181ac36bd None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.814723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5825569-1e7a-4c83-9619-0fc3de14253d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.823824 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.824566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.825255 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.825623 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.825825 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.833111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.834868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:14.848046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:14.849157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 247/495] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:14.850291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.857539 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.858273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.858610 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.858938 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.869967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.871432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:14.885115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:14.886181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:14.887049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:14.887049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:14.887049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:14.887049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 249/496] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:14.887262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:14.952283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cfbd2-4bd7-448f-99e6-ffd870b35f2e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.971242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:14.986127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:14.986758 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:14.987034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:14.987304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:14.987886 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104153ab-05e0-4d33-9dde-6fdd480dd4ee None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:14.995366 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:14.996826 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:15.008265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:15.009398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 248/497] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:15.010436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.024062 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.024638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.024947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.025237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.025889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:15.026183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.027558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.035326 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 250/498] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:15.036098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.060372 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.115622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dbf2b-8c0c-450a-8f74-d3d7810bd073 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.139684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1e20e-8057-4542-8e8f-810768940133 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.154200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.154831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.155099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.155370 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.156092 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:15.156396 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.157890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.174104 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.174706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.174982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.175254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.175888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:15.176184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.177592 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.190392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 251/499] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:15.191213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.196109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 249/500] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:15.196858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.236558 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.276770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.295659 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846ab1a-7f9d-4041-88cb-acbe5f4b1c19 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.296174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaba1c3-1159-406a-bcc7-91cdfed3e8c6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.330087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.330688 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.330792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.331004 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.331281 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.331413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.331539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.331838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.331984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:15.332286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.337581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.346520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.347986 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:15.363439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:15.364541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:15.365520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:15.365520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:15.365520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:15.369053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 250/501] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:15.370038 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.375233 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 252/502] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:15.376066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.464420 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.474862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398354-b6e4-4f03-851e-61befe6adfef None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.478328 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9c67-63f2-46e9-b513-7a3203919ec5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.512331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.513019 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.513298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.513569 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.516263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.517491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.517767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.518039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.521345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.522920 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.528785 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:15.533980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:15.534879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 251/503] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:15.536229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.589067 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.590545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.633844 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24329b5-b779-48a6-8c7e-7fa1a1d8f43c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.667576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.668183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.668459 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.668730 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.669404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:15.669702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.671085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.682593 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 252/504] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:15.683388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.694163 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 253/505] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:15.694163 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.703001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.731920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.791620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a313ba-b68a-4575-8728-41ace8bb2519 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.792709 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545499a-ef43-457a-8886-af4fbe174cb5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.825732 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.826416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.826695 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.826964 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.827691 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:15.827988 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.828167 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.828779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.829088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.829355 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.829609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.847043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 254/506] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:15.847947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:15.902209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.903608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:15.914471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.944177 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:15.948423 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4f59-0898-4b76-9bbe-91a07471db72 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:15.982427 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:15.983057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:15.983370 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:15.983642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:15.990872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:15.992389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.004263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 253/507] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:16.005139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:16.005244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:16.006063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:16.007025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 255/508] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:16.010076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.103957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4f74c-e871-4fa2-a4c9-bae08a3693e0 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.107697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a59eb-087a-43f1-ba11-745dc0d28bb3 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.114961 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.140574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.141242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.141519 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.141788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.144537 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.145173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.145470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.145718 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.152654 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.154101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:16.168995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:16.170080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:16.171007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:16.171007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:16.171007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:16.171007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 254/509] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:16.171007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.179244 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.222399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.224294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.270268 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d734c-9531-44ea-905f-a65dc9de0e0b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.304502 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.305156 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.305413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.305681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.316094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.317619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.324790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 256/510] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:16.325656 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:16.335991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:16.337021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:16.337873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:16.337873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:16.337873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:16.337873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 255/511] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:16.337873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.354461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.391014 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.435097 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37020efd-a589-4db5-9443-b6c9811ff71a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.451071 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda9cb-7b04-47b1-8e4e-5f40dea4271e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.469601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.470214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.470490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.470751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.471482 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:16.471785 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.473258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.485031 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.485635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.485910 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.486175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.486801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:16.487103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.488461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.490599 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 257/512] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:16.491484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.501236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 256/513] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:16.502073 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.581263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.597462 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa7fda-6cff-497b-bcb9-b380e021e04e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.605927 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fc1d6-98cb-4395-94ff-5216c5963a42 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.613762 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.631811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.632534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.632803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.633098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.638989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.639605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.639881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.640501 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.641178 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:16.641488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.642865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.643268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.644716 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.653898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 257/514] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:16.654696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:16.658887 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:16.659870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:16.660789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:16.660789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:16.660789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:16.660789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 258/515] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:16.660789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.759544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76835bb8-e420-448c-bc53-941a198d780b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.762857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281b25c-3184-4ee1-b5d5-c3145945d7bc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.793845 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.794454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.794736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.795012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.797715 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.798249 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.798878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.799203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.799442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.806397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.807863 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:16.819662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:16.820671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 259/516] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:16.821782 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.850439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:16.866874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.868340 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.928417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f442b1-deeb-4931-bb18-7995164b31bd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:16.963383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:16.964011 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:16.964289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:16.964557 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:16.969995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 258/517] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:16.970841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:16.971158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:16.972625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:16.985927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:16.986973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 260/518] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:16.988016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.008655 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.074886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94513-ce5f-4ffa-9a04-59b1097cfa41 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.076618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.088711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5310a-7ea2-4ba7-a74e-bbf41b0d4619 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.107763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.108366 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.108633 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.109002 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.109636 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.109931 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.111296 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.124090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.124261 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 259/519] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.124338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.124338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.124489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.124556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.124556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.124692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.126113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.145054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 261/520] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.145900 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.219310 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.226665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b256a-1913-46c2-8bb7-f2dc61effb50 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.243199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248f4fc-87dd-4a4f-a62f-c32cbc82e377 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.259108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.259815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.260105 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.260376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.271047 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.272556 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.276624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.277262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.277535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.277799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.278477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.278781 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.280228 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:17.286625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:17.287700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:17.288648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:17.288648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:17.288648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:17.288648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 260/521] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:17.288648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.299206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 262/522] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.299206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.306435 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.388056 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e0f4d-e6eb-4aa2-95b4-faf3dc753d78 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.394689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8d004-d938-4ae1-80ea-e2b8b91e7ba0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.421053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.421668 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.421944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.422216 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.426698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.427299 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.427577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.427850 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.428568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=a5bb1cf8265243329e377e2d0a2112f5) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.428929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.429507 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.430512 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.431021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.436348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 263/523] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/role_assignments?user.id=a5bb1cf8265243329e377e2d0a2112f5&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.437516 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:17.444013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:17.445208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:17.446382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:17.448233 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 261/524] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:17.449302 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.461057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.538692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.566442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ddafb-f178-426d-a7b8-e85b00170f7d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.573533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55518f2-c1ac-43b2-9c84-952cab709d61 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.603459 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.604087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.604364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.604635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.605411 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=ab5edd41adff4d35b34dfa7bad99e4a7) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.606028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.607242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.613408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 262/525] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/role_assignments?user.id=ab5edd41adff4d35b34dfa7bad99e4a7&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.614041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.625746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.626556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.626832 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.627158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.627753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.628048 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.629501 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.652927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 264/526] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.659024 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.708510 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.748745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793d7eb-ce6f-45e6-9d46-05a8d0d477e0 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.788816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.789635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.790005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.790366 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.791692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.791692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.793367 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.805411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeed21-4157-4e4a-b267-388f3a68c162 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.819743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 263/527] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:17.821901 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.854813 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.862820 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.863583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.863952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.864311 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.874954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.876791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:17.892927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:17.894033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:17.895393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:17.896868 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 265/528] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:17.902808 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:17.943807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec88ca-7543-4513-ada3-7026542f748e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:17.974322 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:17.981626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:17.982251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:17.982525 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:17.982795 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:17.983515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=c1da13ce94a741168b0e6d09bf9342e4) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:17.983834 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:17.985314 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:18.001317 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 264/529] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/role_assignments?user.id=c1da13ce94a741168b0e6d09bf9342e4&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:18.037277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed7c8-e1a7-469a-a2a1-e1d8a007fc10 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:18.075381 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:18.076267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:18.076692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:18.077179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:18.078074 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:18.078528 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:18.080150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadea681-696d-4869-a2d8-d1ca1fb79bc2 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:18.094718 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 266/530] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:18.103935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:18.223642 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af41b9-a156-48d4-a292-7ece0b9c1022 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:18.258767 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:18.259376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:18.259651 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:18.259918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:18.260644 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=0a022837bc064674a9b648976e37f9cd) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:18.260983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:18.262436 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c8c08-6d33-45c9-8792-b5ef0902361e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:18.268633 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 265/531] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:18 2022] GET /identity/v3/role_assignments?user.id=0a022837bc064674a9b648976e37f9cd&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:19.694804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c61f8-6df5-479b-8ff6-83922b7c2b6c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:19.695380 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c61f8-6df5-479b-8ff6-83922b7c2b6c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:19.695838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c61f8-6df5-479b-8ff6-83922b7c2b6c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:19.697487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 267/532] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:19.703579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a2ef-4278-4422-be31-5159f27a83d0 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:19.704144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a2ef-4278-4422-be31-5159f27a83d0 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:19.704144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208a2ef-4278-4422-be31-5159f27a83d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:19.725779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-2208a2ef-4278-4422-be31-5159f27a83d0 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:19.727388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-2208a2ef-4278-4422-be31-5159f27a83d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:19.784921 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:19.799514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 266/533] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:19.879977 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca72a-18d7-498e-a1e1-9b62fe98843d None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:19.880250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca72a-18d7-498e-a1e1-9b62fe98843d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:19.880518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaca72a-18d7-498e-a1e1-9b62fe98843d None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:19.882278 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 268/534] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:19.890539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da068fc-81d1-44bc-bdc8-6fcfdc550842 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:19.890933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da068fc-81d1-44bc-bdc8-6fcfdc550842 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:19.891304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da068fc-81d1-44bc-bdc8-6fcfdc550842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:19.910326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-7da068fc-81d1-44bc-bdc8-6fcfdc550842 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:19.911513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-7da068fc-81d1-44bc-bdc8-6fcfdc550842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:19.981935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 267/535] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:20.136613 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaca72a-18d7-498e-a1e1-9b62fe98843d None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.197378 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.240626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746e52-e8af-479f-ad98-fbee1b995672 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.240803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746e52-e8af-479f-ad98-fbee1b995672 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.241163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12746e52-e8af-479f-ad98-fbee1b995672 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.242914 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 268/536] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:33:20.247725 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.248002 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.248271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.251020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaca72a-18d7-498e-a1e1-9b62fe98843d None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.267851 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:20.269034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:20.288344 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.289569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.290073 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.290638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.302226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:20.308077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:20.309057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:20.309888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:20.312817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 269/537] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:20.323945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.355227 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 269/538] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:20.356124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.412483 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.465474 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524a317-bbac-481a-9ecd-8eb8ae46767c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.471624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395acd9-537f-4e53-bdaf-452b1bd58b3a None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.480186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.504028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.504901 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.505185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.505454 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.506127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:20.506434 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:20.508199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba47b3-70bf-447f-82f9-2e1436bf1fd7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:20.518041 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 270/539] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:20.519451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24fe7f-bccd-415e-913a-ad65a1fcd0b8 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.519809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24fe7f-bccd-415e-913a-ad65a1fcd0b8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.520081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24fe7f-bccd-415e-913a-ad65a1fcd0b8 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.525043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 271/540] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:20.525043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24fe7f-bccd-415e-913a-ad65a1fcd0b8 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.527272 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca5d1-10db-4633-9156-66db91fd7a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.529231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca5d1-10db-4633-9156-66db91fd7a7a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.529748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca5d1-10db-4633-9156-66db91fd7a7a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.530220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca5d1-10db-4633-9156-66db91fd7a7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.543256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca5d1-10db-4633-9156-66db91fd7a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-0a3ca5d1-10db-4633-9156-66db91fd7a7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:20.548055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:20.549166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:20.549962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 270/541] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:20.550625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.550689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.551274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.569387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:20.570587 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:20.640876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24fe7f-bccd-415e-913a-ad65a1fcd0b8 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.646723 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 271/542] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:20.648020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.677952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.678632 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.679043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.679322 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.690404 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:20.691893 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:20.699527 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:20.706491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:20.707809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:20.708725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:20.708725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:20.708725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:20.712399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 272/543] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:20.713098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.742360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.761087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0a44-af6a-4b3c-b142-6254d73be04a None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.797513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.798807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.799359 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.799772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.800733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:20.801552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:20.803345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:20.816028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 272/544] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:20.817769 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.819468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed27c6-bcd3-4e54-9f04-ab3f10d72e76 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.856924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.857555 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.857828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.858091 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.868341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:20.873505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:20.874604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:20.875407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 273/545] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:20.876096 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:20.932159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.936088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326e7ad-55be-4f6c-a7ef-bf2bb709963a None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.967302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:20.977108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:20.977731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:20.978005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:20.978271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:20.978933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:20.979230 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:20.980603 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:20.984243 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466516-b5ae-4d40-b498-330bde974519 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:20.992195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 273/546] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:20.993053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.021243 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.021794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.022065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.022387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.032609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.034104 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:21.047751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.048670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:21.049572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:21.049572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.049572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:21.050025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 274/547] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.050861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.092127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff6dac-a746-458e-83ab-acc80622f333 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.129499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.129800 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.130077 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.130364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.131034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:21.131355 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.132917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.141612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 274/548] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:21.142406 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.152719 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881acec-4700-4914-acfb-b3f873c6fb09 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.166742 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.186850 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.187485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.187761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.188033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.195210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.199283 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:21.205334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.206241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:21.207028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 275/549] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.207689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.247731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99050da2-ef6c-4348-80a4-40fa800405bf None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.281197 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.281755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.282031 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.282293 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.289677 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.291116 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:21.302392 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.303342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 275/550] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.310733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d28ec-3d5d-4a67-b7cd-1d936a1d062d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.344839 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.345477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.345754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.346037 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.346667 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:21.346963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.348329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.359801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 276/551] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:21.360778 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.386260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.404398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb5848-1879-461e-a849-6e9193416145 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.420969 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.437244 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.437868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.438141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.438408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.448840 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.450303 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.460375 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cd428-5353-449e-8903-239baa7b2d79 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:21.464067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.465117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:21.465993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:21.465993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.465993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:21.465993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 276/552] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.465993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.496399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.497035 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.497301 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.497554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.498209 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:21.498504 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.499863 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.507773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 277/553] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:21.508612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.571211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82a367-7dfb-42e3-b727-e7253dd0958e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.605260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.605862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.606141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.606401 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.607119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:21.607404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.608869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.609570 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc723a-9e36-4ad4-81e0-46aa43418854 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.610529 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.626667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 277/554] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:21.627616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.629778 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.645354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.645988 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.646265 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.646537 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.654258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.655712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:21.667567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.668523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:21.669469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 278/555] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.670062 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.729981 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de12068-b7c4-4421-bc18-e755956678b8 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.765138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.766102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.766438 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.766576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.767220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:21.767509 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.768874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.771299 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be617b23-1baa-4162-918b-b2c9d6ba4ba1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.780497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 278/556] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:21.781248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.806861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.807503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.807768 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.808025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.819224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.821013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.837005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:21.837642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.838779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:21.839811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:21.839811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.839811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:21.839811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 279/557] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.839811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.880770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:21.895761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f04c73-ded4-4722-bf7e-ad2bbf05f860 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.930804 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.931445 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.931720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.931986 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.942374 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.943824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:21.950875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df45914-bdba-43b9-9ef3-7e4999115507 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:21.957790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:21.964079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:21.965122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:21.965122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:21.965122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:21.965122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 279/558] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:21.965122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:21.985996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:21.986608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:21.986885 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:21.987155 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:21.987878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:21.988179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:21.989645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.007191 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 280/559] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.008109 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.064415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918986-9f85-4853-9080-ffa70e628f1e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.066744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.096777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.097066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.098102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.098445 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.098854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.106412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.107044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90f663-a6de-42a7-979e-e8fafe112d57 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.107866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:22.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:22.119984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 280/560] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:22.120983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.151002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.151621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.151895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.152164 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.152808 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:22.153145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.154524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.166103 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 281/561] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.166968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.230483 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a24f21-565c-4b43-a4d0-36c670959cac None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.264655 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.265626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.265899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.266162 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.266793 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:22.267088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.267570 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff9235-5898-4f7a-a5c8-7ef0b10c13d0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.268454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.280632 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 281/562] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.281463 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.302184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.302814 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.303091 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.303359 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.305191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.314021 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.315505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:22.329484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:22.330503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:22.331394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:22.331394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:22.331394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:22.331394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 282/563] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:22.331394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.334028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.381041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1d43a-0afe-437b-828c-c52e2ce0f426 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.415578 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.416185 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.416457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.416723 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.417470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:22.417771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.419179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.435719 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228fea8-c3da-42ee-b377-2b8a73331f9f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.437336 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 282/564] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.438146 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.470564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.471200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.471473 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.471752 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.479296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.480760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:22.492058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:22.493220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 283/565] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:22.494168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.522090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.545372 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701c9fd-e6ec-48b7-b15f-2ff72d1e0488 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.555266 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.581248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.581890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.582170 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.582445 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.589484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.590983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.593436 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf832419-520c-4289-ae20-4ba5d88656af None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:22.602315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:22.603212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:22.604334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 283/566] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:22.605300 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.627603 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.628214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.628493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.628767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.629442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:22.629745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.631181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.644291 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 284/567] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.645143 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.708721 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680e394-6b37-4c66-a075-1d1bfa996402 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.742383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.743006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.743278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.743549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.748302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf2374-0c33-49cb-8070-cffb7b54ef6b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.753931 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.755401 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.757391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:22.771030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:22.772679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:22.773671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:22.773671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:22.773671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:22.773842 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:22.777264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 284/568] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:22.778132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.783673 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.784284 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.784560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.784827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.785577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:22.785878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.787304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.804738 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 285/569] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.805588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.877450 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fa6de-168c-4a60-a91b-28bce226b5bf None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.903833 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757012f-f7cc-4925-9e6b-b89a2a54076f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:22.911001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.911612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.911887 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.912153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.912868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:22.913183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.914624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.928170 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 285/570] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:22.929096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.940167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:22.940800 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:22.941139 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:22.941412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:22.948348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:22.949836 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:22.961084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:22.962148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 286/571] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:22.963457 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:22.991175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.004970 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.037302 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dd6c7-e414-4f08-b0ae-aa0ad54a278e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.066451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63231f2f-6361-4912-84a3-a270469e5abd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.070862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.071477 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.071756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.072029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.072671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:23.073012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.074390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.086221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 286/572] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:23.086991 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.102668 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.103298 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.103574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.103838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.114088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.115563 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:23.131063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:23.132407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:23.133528 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:23.133528 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:23.133528 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:23.137075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 287/573] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:23.137801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.193868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddea49-6717-46b4-811a-12e707ec858b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.207032 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.228244 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.229022 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.229295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.229570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/a5bb1cf8265243329e377e2d0a2112f5/roles/693f05eb783f42cc99fa1743b3632198` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.231725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.240470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d97d7-0dfa-4c54-ac6d-246be69491d2 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.245394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=a5bb1cf8265243329e377e2d0a2112f5, role_id=693f05eb783f42cc99fa1743b3632198)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.246838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.260307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 287/574] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:33:23 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/a5bb1cf8265243329e377e2d0a2112f5/roles/693f05eb783f42cc99fa1743b3632198 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:23.261258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.276882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.277702 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.278099 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.278466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.279277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:23.279684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.281304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.304852 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 288/575] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:23.306025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.408389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79431b-e6ad-457d-8163-00ad72de45ca None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.442218 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c796db-bf45-4f2b-a922-cbfe9ca6005d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.466640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.466855 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.467086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.467312 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.480126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.482095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:23.493643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:23.494796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:23.495940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:23.496498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.496498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.496498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.496498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.496826 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:23.497225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.498176 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 288/576] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:23.503088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.503328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.513419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 289/577] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:23.513419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.530321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.533761 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.637892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4ad62-c7fe-4872-a4f4-76b7d6316c57 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.639583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2553e-39d1-41f1-84fd-1fb1f7b201ab None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.677736 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.678323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.679010 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.679119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.679305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.679578 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/ab5edd41adff4d35b34dfa7bad99e4a7/roles/693f05eb783f42cc99fa1743b3632198` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.679870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.680136 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.680856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:23.681209 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.682857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.695709 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=ab5edd41adff4d35b34dfa7bad99e4a7, role_id=693f05eb783f42cc99fa1743b3632198)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.697281 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.701635 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 290/578] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:23.702641 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.718208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 289/579] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:33:23 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/ab5edd41adff4d35b34dfa7bad99e4a7/roles/693f05eb783f42cc99fa1743b3632198 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:23.719855 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.800606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.843871 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:23.847876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6328fa8-a9fb-49c6-8342-9ac7346e06b8 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.883631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c68e3-8603-48b3-9bcb-875274867991 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:23.910620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.911584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.912015 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.912439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.921796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.923566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.928444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:23.929213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:23.929490 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:23.929758 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/c1da13ce94a741168b0e6d09bf9342e4/roles/693f05eb783f42cc99fa1743b3632198` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:23.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:23.941158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:23.942189 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:23.942629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 291/580] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:23.948448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:23.950722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=c1da13ce94a741168b0e6d09bf9342e4, role_id=693f05eb783f42cc99fa1743b3632198)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:23.953308 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:23.975173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 290/581] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:33:23 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/c1da13ce94a741168b0e6d09bf9342e4/roles/693f05eb783f42cc99fa1743b3632198 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:24.078266 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcae17-c3f2-4724-86a0-ed51edba424e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:24.110858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:24.116200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:24.117146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:24.117714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:24.118044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:24.118816 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:24.119182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:24.120916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b238d42-f47b-4a27-866a-c1b8860e1746 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:24.140861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 292/582] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:24.141992 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:24.251525 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15f84f-de96-4edf-a88d-1939470c764c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:24.276645 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:24.288631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca128067-52c1-4fc5-9b17-8b5b25698bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:24.289539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128067-52c1-4fc5-9b17-8b5b25698bb6 None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:24.290195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128067-52c1-4fc5-9b17-8b5b25698bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:24.290485 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca128067-52c1-4fc5-9b17-8b5b25698bb6 None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/0a022837bc064674a9b648976e37f9cd/roles/693f05eb783f42cc99fa1743b3632198` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:24.306319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca128067-52c1-4fc5-9b17-8b5b25698bb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=0a022837bc064674a9b648976e37f9cd, role_id=693f05eb783f42cc99fa1743b3632198)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:24.307777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca128067-52c1-4fc5-9b17-8b5b25698bb6 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:24.327061 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 291/583] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:33:24 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/0a022837bc064674a9b648976e37f9cd/roles/693f05eb783f42cc99fa1743b3632198 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:25.667272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db0244-60f8-41ef-9f94-6a96682ccde4 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:25.668354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db0244-60f8-41ef-9f94-6a96682ccde4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:25.668888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db0244-60f8-41ef-9f94-6a96682ccde4 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:25.670768 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 293/584] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:25.676200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76155df-133d-4f37-9d57-cf3712d38911 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:25.677077 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76155df-133d-4f37-9d57-cf3712d38911 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:25.677577 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76155df-133d-4f37-9d57-cf3712d38911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:25.695974 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-b76155df-133d-4f37-9d57-cf3712d38911 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:25.697524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-b76155df-133d-4f37-9d57-cf3712d38911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:25.768592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 292/585] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:26.028295 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e15d-53d2-405f-8c61-cd8545991f1a None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.028491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e15d-53d2-405f-8c61-cd8545991f1a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.028764 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e15d-53d2-405f-8c61-cd8545991f1a None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.030543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 294/586] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:26.038566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.039062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.039538 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.062772 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:26.063973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:26.097481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e15d-53d2-405f-8c61-cd8545991f1a None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.149881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 293/587] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:26.215682 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e15d-53d2-405f-8c61-cd8545991f1a None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.251332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bb5ac-ce05-4ec6-bfe5-afda4f8af77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.252350 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb5ac-ce05-4ec6-bfe5-afda4f8af77f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.252867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb5ac-ce05-4ec6-bfe5-afda4f8af77f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.253339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bb5ac-ce05-4ec6-bfe5-afda4f8af77f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.264447 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bb5ac-ce05-4ec6-bfe5-afda4f8af77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-130bb5ac-ce05-4ec6-bfe5-afda4f8af77f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:26.270042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:26.270996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:26.271864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:26.274381 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 295/588] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:26.280488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.316631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:26.328469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c292b-d54b-4175-b6a6-f83e453231b9 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.328753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c292b-d54b-4175-b6a6-f83e453231b9 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.329047 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c292b-d54b-4175-b6a6-f83e453231b9 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.330530 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 296/589] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:26.335886 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.336171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.336562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.359014 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:26.360222 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:26.408779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39888d-d8ff-49a0-88ae-9d63ce64c1c8 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.424862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:26.454110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 297/590] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:26.462483 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.463330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.463796 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.464254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.465173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:26.465667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:26.467237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:26.476869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 294/591] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:26.482971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.496043 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.599193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20125b66-b072-4593-82e2-8bf70a61597d None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.610095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:26.616039 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f47bbe-20b1-4411-a412-697b93858588 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.643046 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.643690 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.643984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.644232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.653138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.653785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.654066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.654338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.655343 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:26.656897 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:26.666807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:26.672087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:26.673256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:26.674608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-b14bdb17-0196-4bdd-a72e-878a8b142cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:26.675273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:26.681242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 298/592] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e34e6f-35c1-4a41-b30c-885b07b7b6eb None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e34e6f-35c1-4a41-b30c-885b07b7b6eb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e34e6f-35c1-4a41-b30c-885b07b7b6eb None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.683664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 299/593] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:26.685312 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 295/594] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:26.685731 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e34e6f-35c1-4a41-b30c-885b07b7b6eb None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.685819 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.719321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:26.786425 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f0a5-ebaa-4ddb-997c-e013e3ea140f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.792160 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e34e6f-35c1-4a41-b30c-885b07b7b6eb None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.820075 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.820676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.820992 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.821263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.821955 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:26.822261 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:26.823620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec99dc-aaef-42a9-8500-303bf12491f9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:26.826460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.827064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.827337 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.827602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.828274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:26.828573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:26.829957 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:26.831551 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 296/595] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:26.832711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.833029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.833305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.847126 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 300/596] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:26.847126 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.851616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:26.852500 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:26.866222 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:26.924233 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 297/597] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:26.925140 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:26.943700 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:26.949632 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a73a-830a-480e-8616-5cc56906b6d1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:26.985429 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:26.986067 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:26.986344 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:26.986617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:26.999025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:27.003679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:27.004652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:27.005542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 301/598] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:27.006253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.043741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c1a92-3ace-45d5-8bb2-41b7a6498f2f None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.078933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.079574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.079855 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.080125 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.090438 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.091882 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.101247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:27.107886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:27.109087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:27.110195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:27.110195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:27.110195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:27.116896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 298/599] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:27.118302 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.124307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f9fbc-c267-4ccd-95e1-676ef450842f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.167546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.168198 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.168469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.168733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.176260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.177745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:27.189601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:27.190578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 302/600] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:27.191560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.210449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.235581 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda4714-9377-41e0-a70e-77962cdc8e58 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.270047 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.270650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.270923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.271190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.271841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:27.272136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.273639 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.281368 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 299/601] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:27.282143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.300051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b18ae2-131b-498d-8e3c-f9b67ee53c11 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.333903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.334509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.334783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.335139 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.335784 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:27.336085 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.337477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.344086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.349594 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 303/602] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:27.354593 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.385082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d86523-ec94-4513-b826-123d5b2993f6 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.420593 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.421242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.421524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.421823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.422530 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:27.422845 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.424301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.428460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.442559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 300/603] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:27.443363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.458998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21db35-4ed6-443f-9e69-1e1b4577a9ea None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.493712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.494338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.494616 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.495250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.504908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:27.509910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:27.510862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:27.511699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 304/604] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:27.512406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.542641 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa4b76-543b-4622-9ca7-e5aefe249201 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.563004 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.577142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.577769 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.578045 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.578309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.588531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.590036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:27.604650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:27.605671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:27.606574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:27.606574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:27.606574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:27.606574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 301/605] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:27.606574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.615826 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310f66-495e-4f8d-b651-9e3af70cf9a5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.650501 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.651066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.651392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.651682 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.653704 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.659744 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.661327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:27.672990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:27.674123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 305/606] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:27.675058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.715221 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02262e-9470-4e21-b75b-6df579f98dc5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.748559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.749334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.749708 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.750074 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.775699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febbc9d-0028-41a0-abf4-eb50205563d3 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.793052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.808448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.809078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.809352 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.809620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.810289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:27.810589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.811953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.819572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.819875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 306/607] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:27.820664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.821412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.881446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:27.927389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd417d-3d39-4c35-ba41-b01b459ef1c5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:27.927817 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 302/608] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:27.928476 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:27.964861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:27.965593 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:27.965855 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:27.966122 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:27.966758 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:27.967052 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:27.968415 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:27.979942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 307/609] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:27.980725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.005584 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.036167 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af76943-190f-4f70-85c2-6fb1cecff744 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.070263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.070875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.071151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.071423 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.072147 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:28.072456 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.073981 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.078729 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70251992-83ad-4f4a-8fcc-02af8a4e9be6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.090738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 303/610] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:28.091543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.099725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.118469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.119098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.119393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.119640 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.135365 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.136880 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:28.153459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:28.154699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:28.155683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:28.155683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:28.155683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:28.155683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 308/611] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:28.155921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.211537 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86480a-3e47-4ef9-8a1a-605cd5cf6a11 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.245295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.251740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.252374 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.252640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.252937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.258580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9ffa8-96e7-4068-bfea-b830de7ff99c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.264500 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.266756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:28.281987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:28.282937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:28.283810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:28.283810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:28.283810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:28.283810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 304/612] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:28.283810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.296777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.297409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.297683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.297944 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.306061 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.307490 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:28.318235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:28.319210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 309/613] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:28.320208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.348065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.390707 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331d56a-292b-4cec-8a6f-1637fc3d3517 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.421662 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f430d6-4fa4-408d-a2cc-af6c07ec9f5e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.424409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.425051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.425329 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.425594 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.458291 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.458893 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.459169 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.459439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.460117 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:28.460409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.461871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.473416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 310/614] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:28.474213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.480970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.504005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.506640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.568652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.583753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e7586-b4ef-4cfa-936b-f679fce0b3dc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.620324 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.620959 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.621232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.621498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.622138 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:28.622431 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.623502 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 305/615] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:28.623795 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.624357 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.635639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 311/616] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:28.636429 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.707939 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.733801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd18c9-ce1b-4ed3-82b9-55db6de3f877 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.737708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba01d-439d-4ce2-90e2-e630465e9dd7 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.767515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.768117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.768391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.768661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.769404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:28.769702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.771143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.771543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.772168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.772440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.772821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.780329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.781777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.788388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 306/617] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:28.789228 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:28.792818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:28.794016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 312/618] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:28.795083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.808881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.893260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f558fb-15be-43f3-a8e4-a2ac6db0153f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.898422 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d054ca-d6ca-469a-99b8-d7a3520fff30 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:28.926785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.927508 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.927971 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.928190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.934483 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:28.935195 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:28.935469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:28.935738 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:28.936547 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:28.939009 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.941118 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.942878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:28.944290 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:28.955917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:28.962025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:28.963150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:28.963150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:28.963150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:28.963323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:28.964141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:28.965220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:28.965963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 307/619] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:28.966053 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 313/620] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:28.966134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:28.966207 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.023618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.058308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbf896-48be-4279-b418-d5dd74f3616c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.060985 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9762d0-be08-4154-bf0a-4a4f6a827eed None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.091692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.092297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.092573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.092859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.093588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:29.093889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.094166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.094766 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.095040 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.095307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.095413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.113133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 314/621] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:29.113689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.165094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.175334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.176877 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.219197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa771d-3a29-45bf-a46b-fe945cbfaaad None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.246000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.254563 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.255181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.255453 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.255723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.256368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:29.257309 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.258466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.269968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 315/622] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:29.270784 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.282694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 308/623] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:29.283460 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.375087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.379034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3382-5273-40ed-a901-7c5ca925ef9d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.385191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7cc5-b201-4e1e-92cd-6eb11c1b4785 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.411945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.412546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.412818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.413173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.413872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:29.414168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.415596 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.420045 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.420655 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.420963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.421235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.427072 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 316/624] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:29.427963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.479710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.490437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.492148 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.533300 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a3b34-5c92-422b-b109-1f3e32c96534 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.571921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.572550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.572828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.573124 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.580049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.581970 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.583897 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:29.593417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:29.594411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:29.600000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 317/625] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:29.600491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 309/626] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:29.600582 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.600661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.698036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e09655-1bac-4408-a571-5d23941412c6 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.700601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0ad5-9019-4c21-9d32-e3053c420e94 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.707556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.733072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.733675 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.733943 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.734486 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.734907 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=a5bb1cf8265243329e377e2d0a2112f5) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:29.735206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.735626 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.736253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.736526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.736627 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.736791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.742412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 310/627] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/role_assignments?user.id=a5bb1cf8265243329e377e2d0a2112f5&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:29.743208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.748145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.749651 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:29.766282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:29.767304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:29.773658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:29.773658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:29.773658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:29.773658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 318/628] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:29.773658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.816375 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:29.867756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521eefc-6528-4fe9-9ba1-072f7bd5721d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.886256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb35db1-4498-42dc-a239-6ce5a4dd611e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:29.908430 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.909641 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.909916 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.910340 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.922912 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.924404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.925513 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:29.926273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:29.926553 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:29.926820 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:29.927626 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:29.927940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:29.929406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:29.939908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:29.940954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:29.941864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:29.941864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:29.941864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:29.942475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 319/630] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:29.942578 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 311/630] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:29.943109 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.947864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:29.968119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.056991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2a55a-84f3-4f10-b12b-8e31b5fa04fa None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.063466 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d7027-e780-4c6a-b3b6-94a137e66217 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.073433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.092303 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.092945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.093213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.093481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.094123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.094418 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.095784 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.102807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.103419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.103691 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.103957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.104594 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.104913 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.106264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.108054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 320/631] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:30.108789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.124973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 312/632] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:30.126684 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.196506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.219305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f4ce6-a7fa-4092-a13e-4e769ab08427 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.233064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ff34a-277f-446c-bb4f-754c7608dc10 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.254761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.255371 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.255645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.255943 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.256797 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=ab5edd41adff4d35b34dfa7bad99e4a7) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.257044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.258831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.265146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 321/633] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/role_assignments?user.id=ab5edd41adff4d35b34dfa7bad99e4a7&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:30.266107 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.276712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.277842 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.278966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.279465 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.291054 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.293740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:30.312454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:30.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:30.314383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:30.314809 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 313/634] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:30.319718 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.385440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8589cb1-cddf-4881-a618-243b0d49f5b5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.403335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.427853 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.428759 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.429388 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.429847 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.438120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.439917 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:30.455576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:30.456581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:30.457533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:30.463354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 322/635] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:30.463982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.470402 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.474927 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4ec44-e0db-4b86-98f7-70fe89e5b594 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.526592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.527215 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.527491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.528254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.529005 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.529318 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.531048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.549533 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 314/636] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:30.556080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.609349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946b29-2ae4-43d4-8424-08f626cb067f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.650070 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.657411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.658536 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.658888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.659231 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.660277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.660648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.662828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.665505 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faf295-bf80-4713-a1a5-08624e395f97 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.680869 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 323/637] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:30.685641 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:30.711314 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.712959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.713472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.714130 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.715252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=c1da13ce94a741168b0e6d09bf9342e4) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.715712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.718012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bcdc5-6edb-49be-bc9f-2b302059ae35 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.726677 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 315/638] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/role_assignments?user.id=c1da13ce94a741168b0e6d09bf9342e4&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:30.762545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:30.809434 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65df524-7aa4-4d58-8429-c4f5ee041639 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:30.850017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:30.850983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:30.851784 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:30.852212 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:30.853005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=0a022837bc064674a9b648976e37f9cd) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:30.853317 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:30.854818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e1714-0c4e-4d12-b3da-0329222c0a82 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:30.861984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 324/639] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:30 2022] GET /identity/v3/role_assignments?user.id=0a022837bc064674a9b648976e37f9cd&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:32.080094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d075ae-257a-4ffb-aa35-cf54b00332e4 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:32.080633 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d075ae-257a-4ffb-aa35-cf54b00332e4 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:32.080633 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d075ae-257a-4ffb-aa35-cf54b00332e4 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:32.082291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 316/640] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:32.087683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043353-f859-4558-9b43-62ff25260f85 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:32.088085 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043353-f859-4558-9b43-62ff25260f85 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:32.088225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01043353-f859-4558-9b43-62ff25260f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:32.106437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-01043353-f859-4558-9b43-62ff25260f85 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:32.107633 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-01043353-f859-4558-9b43-62ff25260f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:32.180951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 325/641] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:32.504372 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d075ae-257a-4ffb-aa35-cf54b00332e4 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:32.613167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90229-e6b2-4b7f-b021-362592ba9777 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:32.613551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90229-e6b2-4b7f-b021-362592ba9777 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:32.613747 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee90229-e6b2-4b7f-b021-362592ba9777 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:32.616391 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 326/642] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:32.620645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:32.620895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d075ae-257a-4ffb-aa35-cf54b00332e4 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:32.621001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:32.621263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:32.640396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:32.642107 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:32.662055 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:32.662702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:32.662981 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:32.663386 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:32.677353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:32.684020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:32.685089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:32.686000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 317/643] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:33:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:32.691481 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:32.703771 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:32.709564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:32.729652 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 327/644] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:32.805290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ccdad-6c46-45e1-ae27-977f481f7c53 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:32.840550 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:32.841244 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:32.841528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:32.841803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:32.842473 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:32.842778 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:32.844150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c227e5-22af-47f4-a714-b1b6b5fecc5f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:32.853704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 318/645] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:32.862353 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:32.972696 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3322017-aa80-4ecc-be13-3bc37de7c380 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.012651 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.013667 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.013947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.014230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.025470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.027077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.035410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0bfd-741d-4a6f-84af-bb4e35d99b39 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.035709 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0bfd-741d-4a6f-84af-bb4e35d99b39 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.035968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a0bfd-741d-4a6f-84af-bb4e35d99b39 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.038541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 319/646] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:33.044331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.044611 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.044921 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:33.046239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:33.047170 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:33.048306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:33.048306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:33.048306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:33.048306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 328/647] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:33.053338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.068818 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:33.070277 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:33.102514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.145176 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 320/648] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:33.146271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.150814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.174894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16165e75-bf77-4830-a202-2b561cbdf2c5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.208998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.209602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.209874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.210260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.210898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:33.211193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.212552 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05f144-0608-42e4-870d-08da0f641fef None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.229984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 329/649] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:33.229984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e7562-8ecc-4bc2-802d-949146171add None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.229984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e7562-8ecc-4bc2-802d-949146171add None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.229984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e7562-8ecc-4bc2-802d-949146171add None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.229984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 330/650] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:33.230979 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e7562-8ecc-4bc2-802d-949146171add None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.256701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83370b-973d-4a34-b54a-0e502de315d9 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.297762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.298872 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.299380 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.300299 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] PATH_INFO: `/v3/services/image` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.301394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.304018 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-7f0c42b9-e58b-4813-adf8-42a41ff8b704 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:33.318173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:33.319232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:33.320155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:33.322050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 321/651] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:33.323209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.323471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.323739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.336008 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.341211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e7562-8ecc-4bc2-802d-949146171add None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.342638 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:33.343808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:33.379769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.381113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.381404 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.381678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.389229 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.391339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:33.404634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:33.405912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 331/652] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:33.407247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.412733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.420052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 322/653] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:33.421349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.525025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b48e67-9242-4432-a60e-f5424906b126 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.544307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a9589-516a-4fe3-9382-77bc48aadda6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.565541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.566161 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.566444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.566710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.567442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:33.567747 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.569217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.583198 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.583925 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.584202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.584471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.585355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] RBAC: Adding query filter params (name=image) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:33.585803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.587360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.592519 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 323/654] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:33.592519 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.602060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 332/655] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:33.602060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.627666 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.652573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.698123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf443eed-13ba-4ec5-8eae-c2b6a44f84ec None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.709293 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095faf0-b25a-4f59-ad47-9f803de75b00 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.734348 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.734982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.735257 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.735526 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.736100 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.737499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.746447 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:33.746831 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:33.747807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:33.748624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:33.749400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.749400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.749400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.749573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 324/656] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:33.749573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.818024 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.819573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.843723 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.851057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058f7f-a96c-4492-9291-30a78dc89a79 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:33.871032 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:33.886153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:33.886758 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:33.887037 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:33.887305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:33.887932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] RBAC: Adding query filter params (type=image) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:33.888223 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:33.889669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:33.895622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 325/657] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:33.896320 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:33.936226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 333/658] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 20:33:33.937071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.009879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40a482-4c9c-4b73-9093-06f9123e956c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.050179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.050950 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.051128 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.051405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] PATH_INFO: `/v3/services/network` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.052004 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.053549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.056687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd300-5fad-455b-afc3-8e38bb1b32a9 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:34.063172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:34.064341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:34.069680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 326/659] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:34.070652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.091399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:34.109382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.110019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.110192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.110459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.111156 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:34.111449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.112919 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.121107 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 334/660] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 3 20:33:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:34.122257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.132028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:34.190514 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff518c-5bf7-4a85-873f-f1e3679f4ebd None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.227261 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.227932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.228186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.228459 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.232621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6978ec-9401-4a4d-9a7a-f003b1582d0e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.239579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.241074 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:34.256628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:34.262542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:34.263679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:34.263679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:34.263679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:34.263679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 327/661] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:34.263679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.275621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.276352 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.276690 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.277051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.277750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] RBAC: Adding query filter params (name=network) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:34.278111 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.279487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.284365 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 335/662] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:34.285085 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.339751 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:34.368440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:34.371950 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95b2c1-b1de-41ac-a54a-18ffabc04616 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.394617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf46e-fceb-47b0-8c6f-dd9f74958fb7 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.413096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.413827 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.414173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.414513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.415277 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:34.415638 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.417855 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.424983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 328/663] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:34.425821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.442389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.443026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.443304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.443575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.445604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:34.445604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.446589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.466217 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 336/664] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:34.467342 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.567364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f677625-1567-462a-beb9-e23d5c59b202 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.619113 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.620568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.621148 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.621596 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.622409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] RBAC: Adding query filter params (type=network) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:34.622923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.623153 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df57a63-c41e-4d62-9f86-0badad166d11 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.624648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.641499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 329/665] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:34.643661 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:34.675672 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.676426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.676765 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.677176 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.685184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.686759 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:34.699534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:34.700712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:34.701939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:34.702625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 337/666] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:34.709135 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:34.742844 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:34.827220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961385-ff7e-4a4c-85c0-2a360819d675 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:34.863976 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:34.864602 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:34.864906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:34.865186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:34.865885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:34.866192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:34.867696 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce84c-1c10-4c5f-8718-6eaa43544897 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:34.881045 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 330/667] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:34.887087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:35.001830 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26237363-28a8-4798-8427-6bfcf621a3d5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:35.041268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:35.042182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:35.042610 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:35.043037 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:35.044077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=a5bb1cf8265243329e377e2d0a2112f5) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:35.044529 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:35.046161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e75a45-c844-4aef-96b1-e53644d710d7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:35.052788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 338/668] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:34 2022] GET /identity/v3/role_assignments?user.id=a5bb1cf8265243329e377e2d0a2112f5&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:36.078693 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaff26-727d-4ed1-b0b9-62200d557870 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.079231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaff26-727d-4ed1-b0b9-62200d557870 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.079231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcaff26-727d-4ed1-b0b9-62200d557870 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.080732 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 331/669] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:36.086250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af74a4e-2c52-49e8-a4f8-67f57272d4a0 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.086674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af74a4e-2c52-49e8-a4f8-67f57272d4a0 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.086842 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af74a4e-2c52-49e8-a4f8-67f57272d4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.106521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-0af74a4e-2c52-49e8-a4f8-67f57272d4a0 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:36.107735 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-0af74a4e-2c52-49e8-a4f8-67f57272d4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:36.137356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:36.185871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 339/670] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:36.504450 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaff26-727d-4ed1-b0b9-62200d557870 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:36.612382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:36.626952 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcaff26-727d-4ed1-b0b9-62200d557870 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:36.664618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd83249-0e19-4ad3-8088-9945ced9eaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:36.665283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd83249-0e19-4ad3-8088-9945ced9eaa4 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.665560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd83249-0e19-4ad3-8088-9945ced9eaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.665833 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd83249-0e19-4ad3-8088-9945ced9eaa4 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.666502 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd83249-0e19-4ad3-8088-9945ced9eaa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:36.667947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd83249-0e19-4ad3-8088-9945ced9eaa4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:36.687444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 332/671] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:33:36 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:36.759196 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666614e-6bf8-49bc-b5e8-77ff0a0e6280 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.759865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666614e-6bf8-49bc-b5e8-77ff0a0e6280 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.760333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666614e-6bf8-49bc-b5e8-77ff0a0e6280 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.762430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 340/672] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:36.769157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c093-284e-4efe-b53e-7b28ef9fc0c7 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.769520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c093-284e-4efe-b53e-7b28ef9fc0c7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.769869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509c093-284e-4efe-b53e-7b28ef9fc0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.791206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-4509c093-284e-4efe-b53e-7b28ef9fc0c7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:36.792513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-4509c093-284e-4efe-b53e-7b28ef9fc0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:36.878451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 333/673] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:36 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:36.933510 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b381-b79e-415c-b439-678a628de1cd None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.933801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b381-b79e-415c-b439-678a628de1cd None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.934049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6b381-b79e-415c-b439-678a628de1cd None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.935650 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 341/674] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:36.940920 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7178-6243-44ec-981f-a171666e4b81 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:36.941203 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7178-6243-44ec-981f-a171666e4b81 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:36.941468 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad7178-6243-44ec-981f-a171666e4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:36.960339 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-dfad7178-6243-44ec-981f-a171666e4b81 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:36.961652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-dfad7178-6243-44ec-981f-a171666e4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:37.035884 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 334/675] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:36 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 20:33:37.214760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6b381-b79e-415c-b439-678a628de1cd None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:37.322454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5aafb-5290-4210-a78b-8aab57a99b16 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:37.322965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6b381-b79e-415c-b439-678a628de1cd None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:37.323503 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5aafb-5290-4210-a78b-8aab57a99b16 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:37.323975 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5aafb-5290-4210-a78b-8aab57a99b16 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:37.329401 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 335/676] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:33:37.331045 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:37.331552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:37.332024 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:37.339762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:37.354362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:37.355550 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:37.361475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:37.362094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:37.362375 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:37.362649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:37.363312 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:37.364721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:37.382762 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 342/677] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:33:37 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:37.382762 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:37.415120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:37.465163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 336/678] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:37 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 20:33:37.505840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8639fb-f8cc-433b-beb2-ba9fa3c15229 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:37.544178 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:37.544796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:37.545106 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:37.545371 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:37.546028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:37.547536 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:37.565779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 343/679] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:33:37 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:37.802523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:37.908579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8671b6-2e5c-4189-9933-655371fb3209 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:37.940142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:37.958124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:37.958754 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:37.959032 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:37.959301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:37.970566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:37.975347 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:37.976555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:37.977458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:37.980944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 337/680] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:37.982800 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:38.069263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:38.087524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16aff1-6aef-4804-a3a0-5f9ce7d727aa None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:38.135052 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:38.135937 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.136438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.136960 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.137844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:38.138343 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:38.139920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:38.155046 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 344/681] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:38.156936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:38.256351 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadf5f3-f47f-4bc9-a3b9-48b30166d885 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:38.290746 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:38.291755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.292232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.292720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.303129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:38.305196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:38.321098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:38.322064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:38.323440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:38.323440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:38.323440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:38.330090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 338/682] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:38.331725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:38.435993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476206ac-d9d3-48ad-8dbe-97bf7a7799fb None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:38.471789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:38.472889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.473366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.473892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.474755 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:38.475277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:38.477005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:38.494138 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 345/683] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:38.495843 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:38.669479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:38.730862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be335-7f7c-4601-8627-7f013896d444 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:38.767641 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:38.768278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.768548 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.768816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] PATH_INFO: `/v3/users/nova` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.777223 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:38.778741 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-dab8caed-9a7e-4196-b172-eb61622ca00d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:38.792133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:38.793327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:38.794279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 339/684] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 3 20:33:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:38.799707 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:38.810722 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:38.911005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e91cb-55dc-4aaa-ad8c-9511d44656a4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:38.946470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:38.947448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.947935 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.948417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.949365 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:38.949867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:38.951509 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:38.953927 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d7d62-27e3-413c-9e36-68e622f92715 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.954205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d7d62-27e3-413c-9e36-68e622f92715 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.954475 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d7d62-27e3-413c-9e36-68e622f92715 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.956051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 340/685] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:38.961135 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:38.961412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:38.961679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:38.976948 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 346/686] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 3 20:33:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:38.978732 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:38.980475 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:38.981890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:39.045204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:39.056927 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 341/687] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:33:39.087320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08250d7-4c2e-4437-8c4a-b4c373211c03 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.133313 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.134329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.134862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.135327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.147424 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.149410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:39.165438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:39.166437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:39.167323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:39.167323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:39.167323 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:39.173029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 347/688] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:39.177940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.221494 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:39.285421 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53688c5-5032-4d04-a8bb-a49db3959cbb None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.320736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.321706 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.322200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.322664 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.323941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:39.324425 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.326020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.340065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 342/689] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:39.345924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.393797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.467585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb1f8-dd9a-47d8-9564-e9f5341d9963 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.489051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:39.510253 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:39.514157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.515054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.515537 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.516348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.525093 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.525258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e56122-5a90-47cd-9e5d-f2c78a1e1c64 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.527180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:39.540875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:39.541822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:39.542711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:39.549779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 348/690] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:39.551037 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.562583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.563226 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.563506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.563777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] PATH_INFO: `/v3/services/image` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.564368 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.566128 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:39.577610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:39.578656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:39.579592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:39.583836 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 343/691] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Sep 3 20:33:39 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:39.585251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.690916 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2334b8c-84b0-42da-b97a-8219a857665e None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.729974 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538ccdd-f45c-442d-adb6-4a87d761834b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.733574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.734446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.734945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.735454 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.736360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:39.736934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.738735 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.757314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 349/692] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:39.760062 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.769393 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.770011 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.770288 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.770557 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.771211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] RBAC: Adding query filter params (name=image) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:39.771513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.773126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556ebe9-e193-4106-bf73-391be2c7e419 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.778106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 344/693] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:39.779147 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab182f9-e6bf-4019-9e84-982653a4649c None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.779419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab182f9-e6bf-4019-9e84-982653a4649c None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.779689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab182f9-e6bf-4019-9e84-982653a4649c None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.781282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 345/694] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:39.785894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.786172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.786439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.807753 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:39.809021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:39.810242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:39.822294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:39.884900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 346/695] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:39.886057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:39.892124 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0565343-8740-48c6-939b-6ed9a25393d1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:39.928185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb234b-43a2-4de9-bd4e-b4e83ce7cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:39.929017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb234b-43a2-4de9-bd4e-b4e83ce7cb5e None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.929358 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb234b-43a2-4de9-bd4e-b4e83ce7cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.929710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb234b-43a2-4de9-bd4e-b4e83ce7cb5e None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/a5bb1cf8265243329e377e2d0a2112f5/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.931681 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb234b-43a2-4de9-bd4e-b4e83ce7cb5e None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=a5bb1cf8265243329e377e2d0a2112f5, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:39.933211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb234b-43a2-4de9-bd4e-b4e83ce7cb5e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:39.948364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 350/696] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:33:39 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/a5bb1cf8265243329e377e2d0a2112f5/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:33:39.949580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0b542-58ef-4853-a731-c63805ab8908 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.949858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0b542-58ef-4853-a731-c63805ab8908 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.950172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0b542-58ef-4853-a731-c63805ab8908 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.951558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 351/697] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:39.966356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8acb-b640-435d-9730-b9253512c84a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:39.966631 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8acb-b640-435d-9730-b9253512c84a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:39.966892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b8acb-b640-435d-9730-b9253512c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:39.995895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-842b8acb-b640-435d-9730-b9253512c84a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:39.998355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-842b8acb-b640-435d-9730-b9253512c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:40.003765 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d299d-fe8c-49cb-8550-e9f63019822b None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.054849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.055463 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.055749 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.056090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.056757 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] RBAC: Adding query filter params (type=image) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:40.057131 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.059405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.067206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 347/698] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:40.075575 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.087034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.095383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 352/699] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:40.180801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8bfc8-f6c7-4bb5-929f-6f26bc2a10ae None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.213705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8acb-b640-435d-9730-b9253512c84a None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.229788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.230680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.230960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.231240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] PATH_INFO: `/v3/endpoints` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.232086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] RBAC: Adding query filter params (interface=public, service_id=17f445567b5c497cab07e9a6135129e7, region_id=RegionOne) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:40.232682 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.234139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.247203 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 348/700] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/endpoints?service_id=17f445567b5c497cab07e9a6135129e7&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:40.248326 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.253489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.334852 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b8acb-b640-435d-9730-b9253512c84a None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.339862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.368712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a587-fc62-480f-bfe5-195961382acd None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.381442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.382150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.382586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.382962 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.383554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.385229 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:40.400430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:40.401500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:40.407400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 353/701] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:40.409684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.413508 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.414295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.414572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.414838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.416354 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.418350 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.432995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 349/702] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services => generated 1002 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:33:40.435481 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.529502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.541732 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ea9d-9c2d-4a6e-934e-e558ef7d89d3 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.581766 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.582432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.582707 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.582978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.583749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:40.583944 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.585550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.591071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 354/703] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:40.593936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b408e-ccb0-4a51-a4c2-4a54400d2e69 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.597931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.641114 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.642048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.642326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.642621 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] PATH_INFO: `/v3/services/network` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.643213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.644581 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:40.654025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:40.655219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:40.656059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 350/704] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:40.662579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.666619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.731183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcef3d-1cde-4b14-9689-84e2b7950db5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.775429 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479b94-6146-47ff-9a9f-1c28c159a682 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.779655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.780436 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.780878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.781304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.782083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:40.782543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.784571 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.793578 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 355/705] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:40.799865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.818908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.820223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.821171 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.821648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.822061 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.822841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] RBAC: Adding query filter params (name=network) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:40.823280 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.825338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.833324 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 351/706] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:40.838800 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.919884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492078-b332-42a6-a198-652ac3f26216 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:40.938515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:40.968019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:40.968796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:40.969459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:40.969828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:40.970994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] RBAC: Adding query filter params (interface=public, service_id=9ac61f7d5bc149a08dcf15b9f09ded67, region_id=RegionOne) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:40.971414 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:40.973160 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:40.984127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 356/707] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/endpoints?service_id=9ac61f7d5bc149a08dcf15b9f09ded67&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:40.990447 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:40.998102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a1357-ee4a-46ed-8477-cd042945cef6 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:41.038437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:41.038994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:41.039267 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:41.039535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:41.040865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] RBAC: Adding query filter params (type=network) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:41.040865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:41.041938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:41.052216 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 352/708] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:41.053152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:41.102254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:41.133066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171ad8d-cb01-4145-beac-afdf6ac917e8 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:41.172165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:41.172787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:41.173101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:41.173364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:41.173974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:41.175384 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:41.181649 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3e755-8e89-4c4e-ae7f-955046665fc9 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:41.189583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 357/709] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:33:40 2022] GET /identity/v3/services => generated 1002 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 20:33:41.216452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:41.223160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:41.224185 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:41.224666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:41.225162 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:41.226160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] RBAC: Adding query filter params (interface=public, service_id=9fb57c6039734f98a1da2b26a9c6676c, region_id=RegionOne) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:41.226715 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:41.228413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75a9fe-eecd-4ed8-a16c-ac5dabbfe930 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:41.234997 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 353/710] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:33:41 2022] GET /identity/v3/endpoints?service_id=9fb57c6039734f98a1da2b26a9c6676c&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:41.240518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:41.358488 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5ae48-2e86-4d27-b849-4f86eabb655b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:41.397419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efea3f2-7929-41cc-a0ce-ff907f542115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:41.398135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efea3f2-7929-41cc-a0ce-ff907f542115 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:41.398421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efea3f2-7929-41cc-a0ce-ff907f542115 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:41.398692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efea3f2-7929-41cc-a0ce-ff907f542115 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:41.399307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efea3f2-7929-41cc-a0ce-ff907f542115 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:41.400682 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efea3f2-7929-41cc-a0ce-ff907f542115 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:41.407923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 358/711] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:33:41 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:33:42.275037 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1d102-9106-402b-8ce2-e543ba0d19e9 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:42.275583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1d102-9106-402b-8ce2-e543ba0d19e9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:42.275583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1d102-9106-402b-8ce2-e543ba0d19e9 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:42.277201 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 354/712] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:42.283077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2a48-a7b9-4fdf-9761-61ff063f5f44 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:42.283400 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2a48-a7b9-4fdf-9761-61ff063f5f44 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:42.283678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2a48-a7b9-4fdf-9761-61ff063f5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:42.306999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-ff6e2a48-a7b9-4fdf-9761-61ff063f5f44 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:42.308211 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-ff6e2a48-a7b9-4fdf-9761-61ff063f5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:42.312309 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:42.395272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 359/713] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:42.744029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f41476-2b7d-467d-80d6-819a870a12a2 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:42.744234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f41476-2b7d-467d-80d6-819a870a12a2 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:42.744597 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f41476-2b7d-467d-80d6-819a870a12a2 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:42.746809 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 355/714] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:42.752508 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:42.753417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:42.753893 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:42.774394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:42.775927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:42.801060 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f41476-2b7d-467d-80d6-819a870a12a2 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:42.861078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 360/715] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:42.943204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f41476-2b7d-467d-80d6-819a870a12a2 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:42.984933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636bb81-e850-4690-b509-407136f80752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:42.985584 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636bb81-e850-4690-b509-407136f80752 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:42.985862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636bb81-e850-4690-b509-407136f80752 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:42.986135 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636bb81-e850-4690-b509-407136f80752 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:42.997700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636bb81-e850-4690-b509-407136f80752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-4636bb81-e850-4690-b509-407136f80752 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:33:43.002498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:43.003424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:43.004701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 356/716] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:43.012434 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.098577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:43.141761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5a833-2dfe-44fa-9dd5-8b3ff85f0d32 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.168604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.169256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.169531 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.169805 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.170476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:43.170772 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.172148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.184995 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 361/717] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:43.189982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636bb81-e850-4690-b509-407136f80752 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.219086 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.257371 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:43.321701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636bb81-e850-4690-b509-407136f80752 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.330513 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe187c-f438-442e-a068-f46230f6a9b4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.360452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.361187 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.361467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.361736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.367081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:43.373765 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.374432 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.374708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.374975 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] PATH_INFO: `/v3/services/image` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.375138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.375573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.376618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.377001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:43.387216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:43.388389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:43.389297 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 362/718] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:33:43.400609 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:43.400791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:43.401832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:43.402763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:43.402763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:43.402763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:43.402763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 357/719] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:43.405431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.533341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b86c2-adbc-4dbd-adfc-4a87c3c830e5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.542415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:43.590951 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.591930 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.592220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.592495 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.593195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:43.593498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.594904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d9f61-4017-4e82-a2c4-59ab4f3ae533 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.615099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 358/720] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:43.616494 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050df51-c304-4aa2-91bd-c99f070b4ea6 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.616904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050df51-c304-4aa2-91bd-c99f070b4ea6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.617194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050df51-c304-4aa2-91bd-c99f070b4ea6 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.622890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 359/721] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:43.623895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050df51-c304-4aa2-91bd-c99f070b4ea6 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.665999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d971f3-139a-49b4-b3e2-51753f3a6231 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.724478 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.725151 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.725461 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.725720 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.726354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] RBAC: Adding query filter params (name=image) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:43.726659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.728027 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba9ff-3b3e-40f9-9cf6-a35d1b271df8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.740135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 363/722] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:43.740135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c738a-5ebf-471e-b54c-4a6819743175 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.740135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c738a-5ebf-471e-b54c-4a6819743175 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.740135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c738a-5ebf-471e-b54c-4a6819743175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.768875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-4f3c738a-5ebf-471e-b54c-4a6819743175 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:43.770506 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-4f3c738a-5ebf-471e-b54c-4a6819743175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:43.783692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050df51-c304-4aa2-91bd-c99f070b4ea6 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.823071 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.823702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.823973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.824263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] PATH_INFO: `/v3/users/nova` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.831652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.833166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.839367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:33:43.845390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:43.846361 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 360/723] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:43.847330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.857047 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 364/724] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:43.858202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3b196-78c0-401b-8627-9c1f7ed1aba5 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.858482 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3b196-78c0-401b-8627-9c1f7ed1aba5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.858748 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3b196-78c0-401b-8627-9c1f7ed1aba5 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.860155 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 365/725] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:43.861070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3b196-78c0-401b-8627-9c1f7ed1aba5 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:43.875492 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:43.948793 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217862-dcd5-4a3f-916d-005f5982cded None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.982206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3b196-78c0-401b-8627-9c1f7ed1aba5 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:43.983812 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:43.984493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.984765 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.985062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:43.985681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] RBAC: Adding query filter params (type=image) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:43.985980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:43.987334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0d42-e95f-422c-ab7f-cf1df965caa8 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:43.992688 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 361/726] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:43.993952 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:43.994227 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:43.994493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.012219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:44.013418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:44.025162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.026032 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.026546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.027025 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.027972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:44.028447 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.030181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.049260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 366/727] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Sep 3 20:33:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:44.050253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.092906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 362/728] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:44.094010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.104643 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.138113 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.168176 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b4821-a103-4434-9051-537f445651d1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.205526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.206147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.206426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.206695 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.207369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.208749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.230188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae636-057c-4f5d-862a-f7c47c016d79 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.232320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 367/729] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:33:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:44.233721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.278073 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.279109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.279572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.280027 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.356413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936e4e1-cd48-4d3f-a78e-9f45af9c002f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.359384 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.362786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.364888 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.386492 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.397584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.398476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.398822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.399160 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.399830 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.401454 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:44.411224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:44.412274 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:44.413202 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 368/730] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:44.418563 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.496738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 363/731] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 20:33:44.497769 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.533516 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a01cb-5ef1-4b61-8087-5c9ec5e60ccc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.571108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.572267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.572267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.572520 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.573292 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:44.573553 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.575207 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.582810 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 369/732] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:44.582810 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.622540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df906fa9-ac20-4d4e-8347-cd9d8741d862 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.622725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.642522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.662112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.663195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.663551 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.663836 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] PATH_INFO: `/v3/services/network` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.664876 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.665957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:44.674903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:44.675937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:44.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 364/733] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:44.678276 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.705062 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986c22f-8870-44a9-88f8-d118a8e707dd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.739849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.740469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.740746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.741058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.751675 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.753831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:44.768535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:44.769999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:44.770892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:44.770892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:44.770892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:44.770892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 370/734] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:44.770892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.793258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f7a1c-490f-4ea5-98af-61577eea167b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.830058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.830664 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.830959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.831226 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.831848 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:44.832145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.833563 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.838937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 365/735] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:44.839737 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.864966 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.883629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac490c5-7008-4803-b88a-b4c12c8ffb13 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.886885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:44.927565 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.928443 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.928941 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.929537 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.930371 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] RBAC: Adding query filter params (name=network) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:44.930920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.932580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:44.938083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 371/736] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:44.938874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:44.954126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da95b3-980d-4e47-be36-551d271270eb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:44.990150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:44.990758 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:44.991033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:44.991293 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:44.991923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:44.992234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:44.993604 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.010424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 366/737] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:45.011394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:45.055622 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51f5a7-0611-42a9-9348-92f69cc1435b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:45.092354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:45.093256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:45.093525 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:45.093795 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:45.094526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:45.095942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.115699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5fce5-d7c3-4e08-8699-14032499ff28 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:45.118163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:45.124921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 372/738] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:33:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:45.124921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:45.157124 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:45.160316 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:45.161454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:45.161876 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:45.162358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:45.163360 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] RBAC: Adding query filter params (type=network) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:45.163788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:45.165267 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.172777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 367/739] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:33:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:45.180294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:45.287027 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de866f-4d42-4d05-b719-ca068f0f31b6 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:45.330822 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d52c23-d3cc-410b-ae61-8fb6b633e37c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:45.335940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:45.337032 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:45.337533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:45.338129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:45.348053 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:45.350645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:33:45.368881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:45.369899 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:45.370804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 373/740] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:45.373927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:45.376139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:45.377693 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:45.377693 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:45.381966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:45.381966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:45.381966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.415484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 368/741] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:33:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:33:45.460373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:45.505439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8c223-d9ed-4a51-bf82-c59af537e3a5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:45.551070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:45.552064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:45.552556 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:45.553051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:45.554143 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:45.554683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:45.556379 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0116ff-5187-435d-ac2f-2514e3478593 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.571159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 374/742] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:33:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:45.578228 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:45.604687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:45.687648 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c91722-c0c7-4744-b559-e20ca10ca2a4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:45.722044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:45.723016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:45.723505 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:45.723982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:45.724706 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=a5bb1cf8265243329e377e2d0a2112f5) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:45.725046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:45.726932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b3528-8c73-4091-a200-565371ce1b5e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:45.733326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 369/743] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:33:45 2022] GET /identity/v3/role_assignments?user.id=a5bb1cf8265243329e377e2d0a2112f5&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:46.565271 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418116-6b5c-4ef8-90b8-3e19a861c9a4 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:46.565809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418116-6b5c-4ef8-90b8-3e19a861c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:46.565809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6418116-6b5c-4ef8-90b8-3e19a861c9a4 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:46.567218 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 375/744] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:46.572861 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:46.573271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:46.573458 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:46.592084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:46.593306 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:46.671899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 370/745] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:46 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:46.997714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418116-6b5c-4ef8-90b8-3e19a861c9a4 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:47.102134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6418116-6b5c-4ef8-90b8-3e19a861c9a4 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:47.124874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:47.144676 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011b519-b576-42b2-9e91-ea6c1c02005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:47.145332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b519-b576-42b2-9e91-ea6c1c02005e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.145606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b519-b576-42b2-9e91-ea6c1c02005e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.145872 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011b519-b576-42b2-9e91-ea6c1c02005e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.214456 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011b519-b576-42b2-9e91-ea6c1c02005e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:47.215985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011b519-b576-42b2-9e91-ea6c1c02005e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:47.329239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 376/746] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:33:46 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 20:33:47.330917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:47.347352 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:47.425894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935383d6-5fc6-42c6-abb5-7c28082386e7 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.426171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935383d6-5fc6-42c6-abb5-7c28082386e7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.426437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935383d6-5fc6-42c6-abb5-7c28082386e7 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.427898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 377/747] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:47.432859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.433141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.433405 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.439911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e138cbb5-a1a1-460e-a606-682333137a7e None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:47.451805 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:47.453007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:47.469637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:47.478643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:47.479286 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.479564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.479845 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.490328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:47.491956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:33:47.506837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:47.507896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:33:47.509010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:33:47.509010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:33:47.509010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:47.509010 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 371/748] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:47.514506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:47.530942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 378/749] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:33:47.582867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:47.621366 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52751b-2081-45e6-a7bc-5600ebc944b2 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:47.661146 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:47.661763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.662102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.662415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.663143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:47.663486 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:47.665099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45247839-1702-470c-9af2-65d51cda3009 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:47.677339 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 372/750] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:47.858440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:47.958247 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f431ed-83d3-47bb-bc01-cead54ec6c37 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.958878 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f431ed-83d3-47bb-bc01-cead54ec6c37 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.959313 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f431ed-83d3-47bb-bc01-cead54ec6c37 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.960808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 373/751] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:33:47.961521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f596b-09a9-4b8b-ba6a-4d1311b0b635 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:47.966021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.966300 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.966572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.992150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:47.993795 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:47.997420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:47.998071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:47.998346 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:47.998617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:47.999210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:48.000580 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:48.009783 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:48.010844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:48.011754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 379/752] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:48.017973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:48.035904 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:48.066122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 374/753] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:48.116630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee323e-3e7b-499b-b4c1-4010f1cdfad4 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:48.153686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:48.154298 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:48.154576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:48.154844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:48.155474 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:48.155776 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:48.157178 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:48.161777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 380/754] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:48.168360 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:48.224680 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:48.269756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440bdd4f-b220-414e-b08a-e1ec28e04391 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:48.305412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:48.306017 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:48.306290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:48.306558 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:48.307184 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:48.307479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:48.308868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:48.313487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 375/755] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:48.381414 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:48.468174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:48.491604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807150e0-b3ef-4704-81eb-1861630ee799 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:48.526538 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:48.527167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:48.527438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:48.527698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:48.528294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:48.529686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:48.538296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:48.539835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:48.541043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:48.544416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 381/756] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Sep 3 20:33:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:48.545539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:48.655065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7adf88-d67f-430d-a0fd-35cfce2fc4da None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:48.676631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:48.691152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:48.691760 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:48.692029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:48.692301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:48.692968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:48.693269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:48.694744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e2590-0df7-44e1-ac27-346d10c35467 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:48.699540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 376/757] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 3 20:33:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:48.706396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:48.812220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbab67-219d-404f-895d-ea9f8da467b2 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:48.847254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:48.847861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:48.848138 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:48.848407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:48.849058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:48.849358 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:48.850904 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a511369-ea1d-4197-aa92-0e8405c3b0b6 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:48.855648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 382/758] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 3 20:33:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:50.475229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3193-493e-41d2-b36d-3f9b62481dcc None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:50.475793 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3193-493e-41d2-b36d-3f9b62481dcc None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:50.475793 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b3193-493e-41d2-b36d-3f9b62481dcc None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:50.477118 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 377/759] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:50.482587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035d92-f586-42b1-9853-4c24f3b90288 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:50.483054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035d92-f586-42b1-9853-4c24f3b90288 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:50.483144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5035d92-f586-42b1-9853-4c24f3b90288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:50.496733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:50.502693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b5035d92-f586-42b1-9853-4c24f3b90288 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:50.503879 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b5035d92-f586-42b1-9853-4c24f3b90288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:50.574010 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 383/760] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:50 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:50.901139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3193-493e-41d2-b36d-3f9b62481dcc None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:51.009156 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b3193-493e-41d2-b36d-3f9b62481dcc None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:51.045138 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738abba-fc86-4e36-8177-7a902433fef6 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:51.045410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738abba-fc86-4e36-8177-7a902433fef6 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:51.045677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738abba-fc86-4e36-8177-7a902433fef6 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:51.046343 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:51.046968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:51.047121 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 384/761] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:51.047264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:51.047534 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:51.048200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:51.049619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:51.051864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00da36a-dafc-4c7d-93b9-e7554236b38c None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:51.052147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00da36a-dafc-4c7d-93b9-e7554236b38c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:51.052411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00da36a-dafc-4c7d-93b9-e7554236b38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:51.066962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 378/762] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:33:50 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:51.070693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-d00da36a-dafc-4c7d-93b9-e7554236b38c None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:51.071931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-d00da36a-dafc-4c7d-93b9-e7554236b38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:51.158169 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 385/763] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:51 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:33:51.475722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:51.531204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:51.587963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe5d13-4d39-434c-ab8f-ca61a986ce45 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:51.622695 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb7042-a9be-4a3d-b9cb-b734bc9390ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:51.623295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7042-a9be-4a3d-b9cb-b734bc9390ed None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:51.623576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7042-a9be-4a3d-b9cb-b734bc9390ed None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:51.623846 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7042-a9be-4a3d-b9cb-b734bc9390ed None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:51.624494 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb7042-a9be-4a3d-b9cb-b734bc9390ed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:51.625905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb7042-a9be-4a3d-b9cb-b734bc9390ed None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:51.644883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 379/764] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:33:51 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:53.251669 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0eeba-bc36-48c7-83e7-c94bf63ae996 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:53.252256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0eeba-bc36-48c7-83e7-c94bf63ae996 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:53.252256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0eeba-bc36-48c7-83e7-c94bf63ae996 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:53.253711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 386/765] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:53.259092 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ecff8-189f-4b6b-93f0-6ffc091982c5 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:53.259521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ecff8-189f-4b6b-93f0-6ffc091982c5 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:53.259609 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ecff8-189f-4b6b-93f0-6ffc091982c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:53.279394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-052ecff8-189f-4b6b-93f0-6ffc091982c5 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:53.280579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-052ecff8-189f-4b6b-93f0-6ffc091982c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:53.355528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 380/766] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:53.676282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0eeba-bc36-48c7-83e7-c94bf63ae996 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:53.741557 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:53.783439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0eeba-bc36-48c7-83e7-c94bf63ae996 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:53.798308 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd5bed-2d0a-46c3-b5e0-79e80510e0e0 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:53.798667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd5bed-2d0a-46c3-b5e0-79e80510e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:53.798937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd5bed-2d0a-46c3-b5e0-79e80510e0e0 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:53.800279 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 381/767] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:53.805325 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:53.805673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:53.806003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:53.818779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:53.819440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:53.819718 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:53.819992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:53.820574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:53.821985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:53.825521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:53.826699 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:53.830792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:53.831790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:33:53.833090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 387/768] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:53.838023 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:53.850973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:53.896096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 382/769] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:53 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:53.936011 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36748-6979-43d4-80a5-1a231540b4f5 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:53.961748 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:53.970903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:53.971517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:53.971787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:53.972050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:53.972674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:53.973003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:53.974367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:53.979087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 388/770] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:53.985034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.087932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838af7b2-dd38-4285-bd64-f5add70fd488 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.122802 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.123411 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.123692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.123934 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.127235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:54.127235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.127235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.131694 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 383/771] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:54.138460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.225803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.238945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0472b0-a1ea-4988-8e68-ae82610f010f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.251405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:54.273437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.274047 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.274318 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.274584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.275269 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] RBAC: Adding query filter params (interface=public, service_id=e55d62a64eb14e3cbbb14e401a4329f1, region_id=RegionOne) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:54.275569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.276965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.282028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 389/772] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/endpoints?service_id=e55d62a64eb14e3cbbb14e401a4329f1&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:54.287614 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.326424 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792a97f-5198-4f1c-aa32-3b836b0ea8c8 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.341033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:54.360681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.361345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.361621 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.361891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.362470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.363834 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:54.373275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:54.374309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:54.375674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 384/773] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:54.380462 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.388945 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ed47-cfeb-4176-af64-c76a62e80c5b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.422319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.422918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.423191 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.423453 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.424161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.425550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.431353 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 390/774] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 20:33:54.471253 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:54.487528 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfff85-00cd-4ccc-9897-3824c298a3f4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.523616 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.524257 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.524531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.524797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.525465 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:54.525763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.527167 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.532752 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 385/775] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:54.539175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.647895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641ca4a-feae-4326-963c-39d9697aeb7a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.664885 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:54.685689 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.686293 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.686567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.686838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.687462 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:54.687754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.689147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.694024 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 391/776] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:54.700223 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.806209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0536b7-e27a-4e35-b5cc-44ecbf4e9ef5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.845433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.846038 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.846310 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.846583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.847276 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] RBAC: Adding query filter params (interface=public, service_id=4fcee340a0ec4f76bcd5d0606f2154e5, region_id=RegionOne) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:54.847578 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.848964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e8e06-0527-437d-983b-6d0a5b5e99f3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:54.854294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 386/777] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/endpoints?service_id=4fcee340a0ec4f76bcd5d0606f2154e5&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:54.860133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:54.961307 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4a4e2-41e7-4db4-a49a-a566e4e2fe19 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:54.994990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94813a94-fdf1-4b99-a255-0e2ff1aba2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:54.995589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813a94-fdf1-4b99-a255-0e2ff1aba2ec None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:54.995862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813a94-fdf1-4b99-a255-0e2ff1aba2ec None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:54.996130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94813a94-fdf1-4b99-a255-0e2ff1aba2ec None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:54.996724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813a94-fdf1-4b99-a255-0e2ff1aba2ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:54.998108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94813a94-fdf1-4b99-a255-0e2ff1aba2ec None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:55.004227 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 392/778] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:33:54 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:33:56.665264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649bf8-1f84-4784-a092-8d94b646cefc None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:56.665856 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649bf8-1f84-4784-a092-8d94b646cefc None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:56.665856 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649bf8-1f84-4784-a092-8d94b646cefc None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:56.667141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 387/779] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:56.672493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ce9a-3916-4367-b079-3a64bb634d72 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:56.672998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ce9a-3916-4367-b079-3a64bb634d72 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:56.673108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802ce9a-3916-4367-b079-3a64bb634d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:56.692429 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-7802ce9a-3916-4367-b079-3a64bb634d72 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:56.693779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-7802ce9a-3916-4367-b079-3a64bb634d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:56.736777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:56.765282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 393/780] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:57.096854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60649bf8-1f84-4784-a092-8d94b646cefc None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.117605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:57.155178 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c07ca-f479-4e5a-84fb-0d86342038be None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.155749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c07ca-f479-4e5a-84fb-0d86342038be None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.156228 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c07ca-f479-4e5a-84fb-0d86342038be None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.157644 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 394/781] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:57.163705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.163985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.164256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.184361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:57.186065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:33:57.216212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60649bf8-1f84-4784-a092-8d94b646cefc None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:57.250198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:57.250829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.251098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.251357 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.251928 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:57.253330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:57.258367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 395/782] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:57 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:57.261919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:57.263152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:57.264016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 388/783] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:57.269334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.365135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa10ce2-f536-422a-97ef-80734fe2fd77 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:57.372220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:57.399525 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:57.400124 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.400399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.400671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.401336 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:57.401631 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:57.402996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:57.407825 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 396/784] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:33:57.413693 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.495911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:57.515394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194d8c7-e16d-4a73-8b5d-b4fccc4d3870 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:57.548283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:57.548898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.549204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.549471 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.550097 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:57.550390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:57.551747 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:57.556420 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 389/785] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Sep 3 20:33:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:57.562653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.583774 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.664413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45f8a8-2ee9-4505-bf45-31ee83552208 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:57.684084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5638e-b2fd-45c2-8e10-a039b240d3bb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:57.697776 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:57.698377 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.698646 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.698909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.699564 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:57.700966 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:57.717599 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:57.718292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.718573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.718860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.719443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:57.720803 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:57.721955 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 397/786] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:33:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:33:57.729852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:33:57.730958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:33:57.731915 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 390/787] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Sep 3 20:33:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:33:57.737737 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.768712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:57.851928 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f34edc-9b4f-45e6-9ad8-1737cc257014 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:57.888337 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:57.888989 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:57.889267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:57.889538 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:57.890179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:57.890480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:57.892213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:57.897453 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 398/788] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 3 20:33:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:57.904260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:57.917440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:58.011231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ab3ce-b9b7-4a3f-970c-0b12e401aa75 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:58.045839 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:58.046444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:58.046717 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:58.046984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:58.047606 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:33:58.047900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:58.049314 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34439b95-6de0-4aaf-8529-5244202716e0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:58.054417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 391/789] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Sep 3 20:33:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:33:58.060391 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:33:58.151947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:33:58.167642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca87db-b2ff-417b-abb5-f3b5bd3bda36 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:33:58.201116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce5912-29ce-41ab-8ac9-34ee26d306c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:33:58.201714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5912-29ce-41ab-8ac9-34ee26d306c9 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:58.201987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5912-29ce-41ab-8ac9-34ee26d306c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:58.202252 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce5912-29ce-41ab-8ac9-34ee26d306c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:58.202943 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5912-29ce-41ab-8ac9-34ee26d306c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:33:58.204304 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce5912-29ce-41ab-8ac9-34ee26d306c9 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:33:58.232883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 399/790] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:33:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:33:59.969356 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8905e8-fd7d-4ce9-8813-3921e9e8d51f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:59.969968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8905e8-fd7d-4ce9-8813-3921e9e8d51f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:59.969968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8905e8-fd7d-4ce9-8813-3921e9e8d51f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:59.971225 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 392/791] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:33:59.976780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:33:59.977269 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:33:59.977384 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:33:59.996880 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:33:59.998110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:34:00.076785 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 400/792] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:33:59 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:34:00.405443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f0bc3-498c-4876-bb95-2808900c7a65 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:00.405678 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f0bc3-498c-4876-bb95-2808900c7a65 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:00.405978 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f0bc3-498c-4876-bb95-2808900c7a65 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:00.407298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 393/793] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:34:00.411174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:00.412986 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:00.413346 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:00.414271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:00.434191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:34:00.435391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:34:00.486234 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:00.504644 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 394/794] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:34:00 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:34:00.520923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7889a4-f421-4d9c-af93-edbf966da46f None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:00.555147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:00.555749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:00.556028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:00.556291 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:00.556956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:00.558391 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:00.561028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING keystone.server.flask.common [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 03 20:34:00.578849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.sql.core [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 20:34:00.578849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 20:34:00.578849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [parameters: {'id': '1ce5a3c1bd2442b39d8f987374f543b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 20:34:00.578849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ce5a3c1bd2442b39d8f987374f543b3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ce5a3c1bd2442b39d8f987374f543b3. Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application conn.query(q) Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:34:00.595792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result.read() Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 03 20:34:00.597173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application next(self.gen) Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application yield resource Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application next(self.gen) Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise self.value Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application session.commit() Sep 03 20:34:00.598320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.session.flush() Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application compat.raise_( Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 20:34:00.599262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 20:34:00.600340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application conn.query(q) Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result.read() Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:34:00.601584 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [parameters: {'id': '1ce5a3c1bd2442b39d8f987374f543b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.602551 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:00.603746 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 1ce5a3c1bd2442b39d8f987374f543b3. Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:00.606105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 401/795] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Sep 3 20:34:00 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:34:00.607710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:00.608797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:00.704916 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7fb4b-9182-4bcb-9056-12fdcb8525db None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:00.739342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:00.739972 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:00.740251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:00.740521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:00.747162 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:00.748649 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:34:00.759956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:34:00.760937 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:00.762295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 395/796] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:34:00.767666 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:00.826459 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:00.877409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fce4b-6ab9-4e07-a004-04d98316671a None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:00.892012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:00.902739 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:00.915042 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:00.915687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:00.915961 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:00.916235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:00.916924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:00.917222 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:00.918863 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:00.931874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e78b0-6fb3-431b-8adb-f52bf4706683 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:00.940060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 402/797] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:00.968013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:00.968579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:00.968867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:00.969118 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:00.969720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:00.971208 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:00.980940 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:34:00.982181 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:00.983186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 396/798] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:34:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:34:00.989360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:01.101186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297203f-593d-48e8-877a-9a73cca06667 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:01.145345 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:01.145965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:01.146233 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:01.146503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:01.147141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] RBAC: Adding query filter params (name=compute) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:01.147439 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:01.148956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd04853-1cfc-42ee-8b12-e3948137e49b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:01.155839 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 403/799] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:34:01.164372 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:01.272158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24836108-f098-4e5c-b661-41e1641a9e81 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:01.298461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:01.308999 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:01.309663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:01.309939 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:01.310210 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:01.310850 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] RBAC: Adding query filter params (type=compute) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:01.311153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:01.312531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad8b36-935b-4e6b-9281-aed58c7017fe None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:01.317219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 397/800] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:03.203217 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd570f5-30dc-4bac-ac3d-a4d8b8595ca6 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:03.204094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd570f5-30dc-4bac-ac3d-a4d8b8595ca6 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:03.204094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd570f5-30dc-4bac-ac3d-a4d8b8595ca6 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:03.206214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 404/801] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:34:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:34:03.213163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f301d0-ab68-4097-b15f-40c4c24c9997 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:03.213566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f301d0-ab68-4097-b15f-40c4c24c9997 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:03.213723 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f301d0-ab68-4097-b15f-40c4c24c9997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:03.232980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-86f301d0-ab68-4097-b15f-40c4c24c9997 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:34:03.234157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-86f301d0-ab68-4097-b15f-40c4c24c9997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:34:03.302331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 398/802] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:34:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:34:03.519701 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef718294-4ff7-4711-a9f8-3d8c846a3d80 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:03.519884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef718294-4ff7-4711-a9f8-3d8c846a3d80 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:03.520231 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef718294-4ff7-4711-a9f8-3d8c846a3d80 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:03.521666 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 405/803] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:34:03.527891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:03.528171 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:03.528437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:03.547522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:34:03.548702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:34:03.615720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 399/804] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:34:03 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:34:03.637865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef718294-4ff7-4711-a9f8-3d8c846a3d80 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:03.689300 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:03.742347 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef718294-4ff7-4711-a9f8-3d8c846a3d80 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:03.775058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:03.775587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:03.775856 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:03.776118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:03.776760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:03.778239 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:03.793519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.sql.core [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 20:34:03.793519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 20:34:03.793519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [parameters: {'user_id': '2ec428e420f549838918a6c476f7c013', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 20:34:03.793519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application conn.query(q) Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result.read() Sep 03 20:34:03.800511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 20:34:03.801602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application next(self.gen) Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application yield resource Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application next(self.gen) Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise self.value Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application session.commit() Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 20:34:03.802623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.session.flush() Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application compat.raise_( Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 20:34:03.803549 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 20:34:03.804466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application conn.query(q) Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application result.read() Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 20:34:03.805406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [parameters: {'user_id': '2ec428e420f549838918a6c476f7c013', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:03.806296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 03 20:34:03.807123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:03.808098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 406/805] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Sep 3 20:34:03 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:34:03.808518 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:03.860191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:03.909126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35640660-dfc0-4292-83e4-ba4d7ab7a8b9 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:03.939870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:03.943195 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:03.943836 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:03.944107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:03.944449 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:03.951906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:03.953394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:34:03.964993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:34:03.966136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:03.967234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 400/806] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:34:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:34:03.972118 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:04.044116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52df5ca-9a55-40fd-94e7-0b78a81c1360 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:04.054210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:04.072313 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbda5ad-ce45-4b9a-ae7d-42b3adaffc81 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:04.078958 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911d662-857b-4907-88d0-e1320178a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:04.079561 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911d662-857b-4907-88d0-e1320178a2a1 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:04.079831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911d662-857b-4907-88d0-e1320178a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:04.080095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911d662-857b-4907-88d0-e1320178a2a1 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:04.080738 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911d662-857b-4907-88d0-e1320178a2a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:04.082334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911d662-857b-4907-88d0-e1320178a2a1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:04.082832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:04.100242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 407/807] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:34:03 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:34:04.116065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:04.116739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:04.117101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:04.117474 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:04.118198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:04.118520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:04.119976 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95694b-3eac-48d6-bfaa-65fa45e41ed2 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:04.161431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 401/808] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Sep 3 20:34:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:06.302708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b959ca0-1f2b-4975-99ba-96aedc94e250 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:06.303265 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b959ca0-1f2b-4975-99ba-96aedc94e250 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:06.303265 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b959ca0-1f2b-4975-99ba-96aedc94e250 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:06.304645 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 408/809] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:34:06.311012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:06.311744 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:06.311923 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:06.340263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:34:06.341495 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:34:06.415570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 402/810] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:34:06 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:34:06.751034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b959ca0-1f2b-4975-99ba-96aedc94e250 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:06.867881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b959ca0-1f2b-4975-99ba-96aedc94e250 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:06.904076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:06.904697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:06.905002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:06.905269 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] PATH_INFO: `/v3/services/compute` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:06.905843 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:06.907216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:06.915967 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:34:06.917184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:34:06.918389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 409/811] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:34:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:34:06.924060 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:07.046559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:07.057235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c97577-7f6d-4461-b3a9-8de36e6e30aa None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:07.094753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:07.095353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:07.095631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:07.095904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:07.096535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] RBAC: Adding query filter params (name=compute) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:07.096870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:07.098239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:07.103651 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 403/812] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:07.112550 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:07.155612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:07.225446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624438cc-7e7a-4e37-9c5c-11b31ff6115b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:07.265407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:07.266005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:07.266630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:07.266904 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:07.267526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:07.267819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:07.270064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:07.276159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 410/813] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:07.284512 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:07.393294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683ed76-82d5-43ec-8240-535c6e21e70d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:07.426296 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:07.426917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:07.427188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:07.427454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:07.428144 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] RBAC: Adding query filter params (interface=public, service_id=34c54724bb97445a86a615973b3078b0, region_id=RegionOne) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:07.428441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:07.429879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023d620-3f6a-4b9f-a3b9-c063a33dd2f3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:07.434759 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 404/814] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:34:07 2022] GET /identity/v3/endpoints?service_id=34c54724bb97445a86a615973b3078b0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:07.440640 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:07.560972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:07.565774 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a1e1e-6c2e-4880-b52c-86f9ee8499d7 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:07.604810 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afc56b-6ad7-4c58-8b14-f2c5054d795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:07.605440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc56b-6ad7-4c58-8b14-f2c5054d795e None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:07.605712 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc56b-6ad7-4c58-8b14-f2c5054d795e None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:07.605976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afc56b-6ad7-4c58-8b14-f2c5054d795e None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:07.606573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc56b-6ad7-4c58-8b14-f2c5054d795e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:07.607939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afc56b-6ad7-4c58-8b14-f2c5054d795e None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:07.614216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 411/815] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:34:07 2022] GET /identity/v3/services => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:34:09.766909 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d970f-e4f8-4e12-a968-af41ef0e2ba5 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:09.767809 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d970f-e4f8-4e12-a968-af41ef0e2ba5 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:09.767809 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d970f-e4f8-4e12-a968-af41ef0e2ba5 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:09.769957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 405/816] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:34:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:34:09.775568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:09.775993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:09.776083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:09.796043 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:34:09.797568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:34:09.867466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 412/817] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:34:09 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:34:10.187008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d970f-e4f8-4e12-a968-af41ef0e2ba5 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:10.222706 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:10.313030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d970f-e4f8-4e12-a968-af41ef0e2ba5 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:10.349314 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:10.349932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:10.350202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:10.350462 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] PATH_INFO: `/v3/services/compute` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:10.351058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:10.352446 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:34:10.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:34:10.362823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:34:10.363663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 406/818] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:34:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:34:10.371569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:10.464935 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:10.475980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05756f49-bd4b-4439-a630-9dfc65e43f98 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:10.514383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:10.514984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:10.515257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:10.515519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:10.516143 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] RBAC: Adding query filter params (name=compute) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:10.516778 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:10.518156 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:10.523302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 413/819] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:10.529506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:10.620617 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:10.643622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd4df-40ff-4a66-92e9-132ccfda844c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:10.680757 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:10.681388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:10.681662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:10.681956 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:10.682568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] RBAC: Adding query filter params (type=compute) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:34:10.682866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:10.684497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6d7b0-7352-4850-a5ab-e594effd79bb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:10.689438 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 407/820] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Sep 3 20:34:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:34:10.697582 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:34:10.801532 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e96504-a666-44c1-8f6c-061678b5e39c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:34:10.835935 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbc9b9-7525-44a8-9298-326a1bcc833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:34:10.836535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc9b9-7525-44a8-9298-326a1bcc833f None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:34:10.836806 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc9b9-7525-44a8-9298-326a1bcc833f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:34:10.837112 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbc9b9-7525-44a8-9298-326a1bcc833f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:34:10.837770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbc9b9-7525-44a8-9298-326a1bcc833f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:34:10.839127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbc9b9-7525-44a8-9298-326a1bcc833f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:34:10.861861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 414/821] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:34:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:34:20.686795 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=25 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:34:20.858091 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:13.858626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5874-cd32-4df2-9ad4-2d2b9604cf79 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:13.859264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5874-cd32-4df2-9ad4-2d2b9604cf79 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:13.859264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5874-cd32-4df2-9ad4-2d2b9604cf79 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:13.860541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 408/822] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:35:13.867183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:13.867775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:13.867898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:13.888589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:13.889819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:13.981628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 415/823] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:14.349667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5874-cd32-4df2-9ad4-2d2b9604cf79 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:14.472510 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5874-cd32-4df2-9ad4-2d2b9604cf79 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:14.510164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:14.510814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:14.511078 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:14.511348 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:14.524318 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:14.526082 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:14.541867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:14.543143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:14.544116 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:14.544116 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:14.544116 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:14.544116 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 409/824] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:14.549667 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:14.666209 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43380387-1694-4229-a1a9-ef2582d74733 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:14.696395 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:14.707322 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:14.707965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:14.708293 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:14.708516 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:14.709321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:14.709607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:14.711095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c030d-8392-4f99-b6b3-61457d2665f5 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:14.724479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 416/825] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:35:14.733960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:14.792594 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:14.853006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557bb5-ccb2-4a52-bfab-69c387c0d5f0 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:14.893817 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbe84e-b0dd-4259-9145-1946c10a65bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:14.894565 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbe84e-b0dd-4259-9145-1946c10a65bf None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:14.894754 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbe84e-b0dd-4259-9145-1946c10a65bf None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:14.895022 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbe84e-b0dd-4259-9145-1946c10a65bf None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:14.895643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbe84e-b0dd-4259-9145-1946c10a65bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:14.897214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbe84e-b0dd-4259-9145-1946c10a65bf None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:14.923039 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 410/826] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Sep 3 20:35:14 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:35:17.301150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d1c0-7e76-496c-bc21-062514ad1bb9 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:17.301780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d1c0-7e76-496c-bc21-062514ad1bb9 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:17.301780 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d1c0-7e76-496c-bc21-062514ad1bb9 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:17.303146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 417/827] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:17.309841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:17.310331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:17.310483 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:17.332003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:17.333334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:17.410086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 411/828] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:17 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:17.753857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75d1c0-7e76-496c-bc21-062514ad1bb9 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:17.866650 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75d1c0-7e76-496c-bc21-062514ad1bb9 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:17.906569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:17.907294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:17.907581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:17.907834 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:17.920484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:35:17.925840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:17.927087 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:17.928102 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 418/829] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:35:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:17.934860 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:17.980131 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:18.044355 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b9e3-8e04-423e-b505-8508fee19c59 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:18.080767 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:18.081427 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:18.081705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:18.081985 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:18.082650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:18.082952 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:18.084329 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:18.093058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 412/830] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:18.099631 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:18.154034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:18.213364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36831603-df63-4167-9bb6-91ec50c54acf None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:18.253444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:18.254180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:18.254606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:18.254903 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:18.268225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:18.270015 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:18.287175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:18.288416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:18.289602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:18.289602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:18.289602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:18.289602 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 419/831] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:18.295058 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:18.400583 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:18.404053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784e90d-89d3-4bb5-8aa8-72af599eaea4 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:18.443432 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:18.444131 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:18.444382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:18.444736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:18.445964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:18.445964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:18.447277 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:18.461437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 413/832] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:18.468190 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:18.584875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:18.589976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5dc8-8724-44f0-b54d-0da6f40a82df None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:18.628530 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:18.631399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:18.631399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:18.631399 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] PATH_INFO: `/v3/users/placement` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:18.638767 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:18.640469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:35:18.654912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:18.656199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:18.657308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:18.658348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 420/833] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:18.664237 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:18.769857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f627-f048-42f7-a65b-949948bc8788 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:18.807993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:18.808652 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:18.810896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:18.810896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:18.810896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:18.810896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:18.812299 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:18.832612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 414/834] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 3 20:35:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:18.840166 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:18.944310 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a86b1f-a333-46d4-a363-8f28cceed57f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:18.979392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:18.980174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:18.980576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:18.980950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:19.008976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:19.050150 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:19.051773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:19.177440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 421/835] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:35:18 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 20:35:19.178801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:19.198919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:19.288196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580a5c7-ac88-4056-996d-0b5e47d3ef17 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:19.328249 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:19.328929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:19.329213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:19.329485 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:19.340865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:19.342515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:19.357743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:19.358929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:19.360183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:19.360183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:19.360183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:19.360183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 415/836] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:19.364811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:19.426017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:19.470803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7d5d0-e37b-403b-884d-0135cac26f5b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:19.508659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:19.509385 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:19.509697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:19.509940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:19.510681 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:19.510977 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:19.512522 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:19.525314 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 422/837] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:19.531186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:19.609875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:19.643415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5ddac-f89d-4697-b3db-e6c0d7836dd5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:19.681359 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:19.681917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:19.682196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:19.682466 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:19.691383 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:19.693190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:35:19.706304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:19.707816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:19.709426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:19.712885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 416/838] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:19.714586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:19.827715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5f0a-c6ee-4aab-950d-04a99da40466 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:19.845779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:19.864296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:19.865078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:19.865359 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:19.865679 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:19.866468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:19.866861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:19.868878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b47fe-f504-4ab4-835b-bd8625d740d2 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:19.884246 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 423/839] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:19.891103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:20.011979 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4469-63e3-455e-8f5d-a123507ac327 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:20.046943 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:20.055713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:20.056412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:20.056705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:20.057020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:20.057753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=abb0c39276f6470b92b022e1ea3ebc88) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:20.058068 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:20.059612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa338-442c-4637-99fb-a745043da6e1 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:20.065480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 417/840] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:35:19 2022] GET /identity/v3/role_assignments?user.id=abb0c39276f6470b92b022e1ea3ebc88&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:22.354973 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f9d0-e068-44f0-8b31-e09e77112069 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:22.355558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f9d0-e068-44f0-8b31-e09e77112069 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:22.355558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f9d0-e068-44f0-8b31-e09e77112069 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:22.356911 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 424/841] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:22.362332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:22.362771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:22.362867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:22.383631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:22.384952 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:22.457295 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 418/842] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:22 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:22.799815 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0f9d0-e068-44f0-8b31-e09e77112069 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:22.914983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0f9d0-e068-44f0-8b31-e09e77112069 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:22.950451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:22.951114 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:22.951370 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:22.951638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:22.961970 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:35:22.966777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:22.967922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:35:22.968983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:22.974154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:22.976226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 425/843] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:23.082042 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d142-22d9-451a-be86-e8d67d738a20 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:23.109736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:23.129369 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:23.130037 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:23.130358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:23.130704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:23.131492 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] RBAC: Adding query filter params (name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:23.131865 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:23.133773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:23.144549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 419/844] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:23.151415 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:23.197786 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:23.267763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b53ec-91ed-47f5-847d-6fc7f9e2c4bc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:23.307146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:23.307802 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:23.308137 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:23.308419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:23.320408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:23.322375 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:23.339080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:23.340280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:23.341368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:23.341368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:23.341368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:23.341368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 426/845] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:23.346997 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:23.458919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d904fe5-a2ff-46fb-b47e-a0bd56ade11f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:23.502584 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:23.503238 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:23.503512 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:23.503782 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:23.504513 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:23.504813 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:23.506323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:23.519869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 420/846] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:23.526951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:23.632904 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:23.644419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e512f-b773-44e0-864d-48d26fcd7b35 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:23.681530 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:23.682165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:23.682450 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:23.682697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:23.691208 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:23.692893 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:35:23.705070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:23.706438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:23.707787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 427/847] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:23.713093 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:23.764388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:23.823878 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248f59a-63e6-401a-9b3a-a882938557d9 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:23.862879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:23.863507 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:23.863789 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:23.864063 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:23.864788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:23.865124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:23.866568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:23.890121 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 421/848] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 3 20:35:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:23.891378 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:24.006956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25096fb-affb-46b9-8486-0d679aad7cbd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:24.046259 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:24.047045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:24.047330 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:24.047601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:24.059565 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:24.061059 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:24.076158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:24.077663 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:24.078591 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:24.078591 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:24.078591 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:24.078591 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 428/849] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:24.083987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:24.218025 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edad249-170f-4f6f-bfd1-5914f90b34c0 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:24.220337 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:24.258196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:24.259183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:24.259183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:24.259679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:24.260095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:24.260399 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:24.261971 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:24.275379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 422/850] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:24.281152 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:24.284638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:24.393108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ef4ff-46d0-4be1-a6f6-b94f40604bfd None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:24.429118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:24.430022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:24.430305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:24.430577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:24.437569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:24.439062 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:35:24.451078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:24.452185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:24.453357 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 429/851] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:24.458596 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:24.563906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52b57-a05f-446a-9ee1-f847a282ab8e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:24.602085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:24.602793 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:24.603076 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:24.603384 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:24.604183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:24.604498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:24.606257 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78a132-2d17-4845-82b6-62df23ecfe65 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:24.619085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 423/852] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:24.625308 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:24.695075 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:24.741272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c64be-7dff-4b91-bdf9-0213f24b0d93 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:24.777379 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b67a0-d28e-4e25-8ad2-b2f69e4a3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:24.778125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b67a0-d28e-4e25-8ad2-b2f69e4a3d86 None admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:24.778438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b67a0-d28e-4e25-8ad2-b2f69e4a3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:24.778741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b67a0-d28e-4e25-8ad2-b2f69e4a3d86 None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/abb0c39276f6470b92b022e1ea3ebc88/roles/693f05eb783f42cc99fa1743b3632198` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:24.797217 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b67a0-d28e-4e25-8ad2-b2f69e4a3d86 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=abb0c39276f6470b92b022e1ea3ebc88, role_id=693f05eb783f42cc99fa1743b3632198)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:24.799135 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b67a0-d28e-4e25-8ad2-b2f69e4a3d86 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:24.814756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 430/853] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:35:24 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/abb0c39276f6470b92b022e1ea3ebc88/roles/693f05eb783f42cc99fa1743b3632198 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:35:27.164319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575fe23-96c3-4e6c-8e66-b4c4cd904875 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:27.165016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575fe23-96c3-4e6c-8e66-b4c4cd904875 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:27.165016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575fe23-96c3-4e6c-8e66-b4c4cd904875 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:27.166478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 424/854] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:27.172333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:27.172777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:27.173039 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:27.192750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:27.193978 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:27.272950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 431/855] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:27.618834 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575fe23-96c3-4e6c-8e66-b4c4cd904875 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:27.648936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:27.740353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575fe23-96c3-4e6c-8e66-b4c4cd904875 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:27.778690 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:27.779330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:27.779606 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:27.779874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:27.790450 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:35:27.795539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:27.796705 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:27.798072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 425/856] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Sep 3 20:35:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:27.803251 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:27.855098 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:27.919998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec88e8a-a5d9-477e-ab14-fcc58ba3f9c1 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:27.957818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:27.958543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:27.958818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:27.959113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:27.959870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] RBAC: Adding query filter params (name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:27.960270 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:27.961961 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:27.971728 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 432/857] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Sep 3 20:35:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:27.977919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:28.068283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:28.086604 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f722-b29b-40b3-b3e3-f29517691b9d None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:28.132977 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:28.133726 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:28.134008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:28.134282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:28.147041 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:28.149008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:28.166498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:28.168106 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:28.169405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:28.169405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:28.169405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:28.169405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 426/858] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:28.174053 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:28.283938 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e56e-cd73-4bfa-88a1-f64ebb37d72d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:28.286493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:28.320260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:28.321079 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:28.321406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:28.321630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:28.322411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:28.322792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:28.324268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:28.337745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 433/859] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:28.343966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:28.457153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711551e-8ee6-455f-9839-529a18ea06a9 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:28.497077 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:28.497957 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:28.498409 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:28.498805 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:28.502524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:28.508085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:28.509926 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:35:28.521898 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:28.523145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:28.524341 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 427/860] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:28.529191 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:28.633234 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d1ebe-812e-416a-9150-d053113b668f None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:28.671969 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:28.672708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:28.673065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:28.673349 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:28.674159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:28.674476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:28.676027 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:28.695908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 434/861] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 3 20:35:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:28.701552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:28.811763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93b0fe-641e-470e-8d35-2743dfd84831 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:28.846764 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:28.847369 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:28.847666 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:28.847918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:28.914989 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:28.922805 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:28.924541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:29.033479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 428/862] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:35:28 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 20:35:29.039670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:29.067316 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:29.150828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d72af5-e95e-48a9-9c53-83e98b7c51c1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:29.187866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:29.188543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:29.188789 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:29.189070 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:29.199709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:29.201201 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:29.218119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:29.219362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:29.220366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:29.220366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:29.220366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:29.220366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 435/863] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 20:35:29.225323 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:29.329043 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:29.335596 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf01f9-ea9f-41b0-a0e4-804ce6529dcb None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:29.371033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:29.371642 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:29.371919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:29.372192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:29.372825 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:29.373161 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:29.374547 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:29.386351 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 429/864] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:35:29.392777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:29.475364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:29.502037 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda407b-f2f8-45b9-ab0d-071c778ac3f1 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:29.536786 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:29.537463 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:29.537728 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:29.537996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:29.545092 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:29.546542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:35:29.557517 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:29.558628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:29.559611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 436/865] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:29.564813 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:29.670906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004301a5-1fb2-45e6-87ea-06b8594179d5 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:29.711051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:29.711806 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:29.712199 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:29.712498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:29.713233 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:29.713535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:29.715048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d4d47-48f1-47c5-bb00-bff1ef23c78c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:29.731433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 430/866] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:29.737757 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:29.859094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493798d-bef4-4c54-a615-2382c0d4ffbe None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:29.899095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:29.899725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:29.900086 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:29.900356 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:29.901149 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] RBAC: Adding query filter params (role.id=693f05eb783f42cc99fa1743b3632198, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=abb0c39276f6470b92b022e1ea3ebc88) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:29.901484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:29.902926 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3672-d7f2-4f4a-8531-bce986495e39 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:29.904676 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:29.912864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 437/867] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:35:29 2022] GET /identity/v3/role_assignments?user.id=abb0c39276f6470b92b022e1ea3ebc88&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=693f05eb783f42cc99fa1743b3632198 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:32.328022 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e601c-1016-484f-b58a-6696d869ee97 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:32.328773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e601c-1016-484f-b58a-6696d869ee97 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:32.328773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e601c-1016-484f-b58a-6696d869ee97 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:32.329972 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 431/868] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:35:32.335725 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:32.336860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:32.336860 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:32.355693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:32.357049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:32.432394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 438/869] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:35:32.768196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e601c-1016-484f-b58a-6696d869ee97 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:32.787340 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:32.885710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e601c-1016-484f-b58a-6696d869ee97 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:32.923133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:32.923929 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:32.924294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:32.924631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:32.934964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:35:32.939731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:32.940947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:32.941849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 432/870] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:32.948452 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:33.056477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b540c-0fe6-4d43-8191-40c5d328803a None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:33.084058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:33.093258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:33.093917 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:33.094258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:33.094545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:33.095394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:33.095722 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:33.097456 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:33.107026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 439/871] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:35:33.112889 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:33.198236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:33.223288 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c637c-1b66-43bf-afd7-65314f2b0586 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:33.259387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:33.260023 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:33.260300 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:33.260587 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:33.271470 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:33.273036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:33.287283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:33.288672 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:33.289807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:33.289807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:33.289807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:33.289807 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 433/872] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:33.294344 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:33.398514 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840254f-603b-45c9-92f2-27881b32389d None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:33.432925 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:33.433570 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:33.433839 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:33.434163 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:33.434756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:33.435060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:33.436411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:33.448974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 440/873] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:33.454733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:33.559595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790996-17ac-4e41-945c-5e84682c1b0c None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:33.588153 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:33.597096 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:33.597826 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:33.598102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:33.598382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:33.606473 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:33.608114 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:35:33.619786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:33.620970 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:33.622155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:33.625900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 434/874] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:33.627034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:33.686521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:33.746272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbdfe1-a65e-4352-b2e4-6ecbde9ba6cc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:33.784796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:33.785501 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:33.785797 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:33.786074 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:33.786857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:33.787289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:33.789200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:33.806947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 441/875] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 3 20:35:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:33.813472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:33.936335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce1606-5be8-495f-9626-7b9343deb206 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:33.975288 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:33.975830 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:33.976115 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:33.976379 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:34.041622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:34.055340 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:34.056788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:34.172959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 435/876] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:35:33 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 03 20:35:34.178988 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:34.294445 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48b077-8164-406b-ac77-4d94316a7483 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:34.306079 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:34.334201 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:34.334839 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:34.335113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:34.335378 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:34.346394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:34.347889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:34.365253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:34.366620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:34.368125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:34.368125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:34.368125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:34.368125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 442/877] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:34.372647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:34.467118 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:34.480629 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5ba75-c323-4698-8574-bbd58baaee1b None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:34.519615 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:34.520225 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:34.520497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:34.520762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:34.521440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:34.521733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:34.523180 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:34.536206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 436/878] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:34.542361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:34.675232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba6072-37f8-48e8-a324-e3617ff3c327 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:34.716508 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:34.717200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:34.717476 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:34.717827 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:34.726205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:34.728045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:35:34.740777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:34.742018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:34.743167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 443/879] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:34.748443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:34.856030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4a02a-7922-469e-badf-aef8c7aa4d9e None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:34.890893 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:34.891505 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:34.891785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:34.892389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:34.893107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:34.893414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:34.894841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a8f60-2a7e-4877-8f2e-c3f2a5d2b87c None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:34.907344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 437/880] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:34.914430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:34.938119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:35.020669 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cf503-7d4a-4e01-b0b1-fc80e8212136 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:35.056289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:35.056938 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:35.057203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:35.057471 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:35.058230 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=abb0c39276f6470b92b022e1ea3ebc88) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:35.058533 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:35.059974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf72a7-7763-458a-bab5-23b28f030ebc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:35.065864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 444/881] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:35:34 2022] GET /identity/v3/role_assignments?user.id=abb0c39276f6470b92b022e1ea3ebc88&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:37.201397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04ea28-5e1b-42cd-bcd3-b3179b5e15fd None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:37.202217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04ea28-5e1b-42cd-bcd3-b3179b5e15fd None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:37.202217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04ea28-5e1b-42cd-bcd3-b3179b5e15fd None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:37.204403 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 438/882] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:37.212373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:37.212876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:37.212876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:37.233029 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:37.234198 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:37.306963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 445/883] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:37 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:35:37.632140 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04ea28-5e1b-42cd-bcd3-b3179b5e15fd None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:37.645283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:37.743272 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04ea28-5e1b-42cd-bcd3-b3179b5e15fd None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:37.781045 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:37.781573 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:37.781847 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:37.782112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:37.793553 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:35:37.798275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:37.799378 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:37.800560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 439/884] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:37.806330 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:37.823256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:37.922787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bcabad-248c-444b-ac09-79e7b5c65d55 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:37.958197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:37.958796 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:37.959066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:37.959325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:37.960250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:37.960381 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:37.961728 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:37.970649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 446/885] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:37.976816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:38.046312 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:38.080720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e66aef-312b-4e32-a4d6-28722f92b7a1 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:38.115600 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:38.116233 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:38.116501 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:38.116969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:38.127725 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:38.129337 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:38.144159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:38.145265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:38.146535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:38.146535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:38.146535 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:38.149057 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 440/886] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:38.151056 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:38.243822 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:38.272765 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45d05-bef5-44cb-9868-c1a5c6d5ed0b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:38.311321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:38.311921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:38.312194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:38.312459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:38.313115 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:38.313417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:38.314819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:38.328518 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 447/887] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:38.338398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:38.451324 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54cfc0-536f-407b-a463-54f3599d5194 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:38.471440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:38.489790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:38.490414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:38.490689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:38.490960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:38.499641 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:38.501062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:35:38.512326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:38.513418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:38.514362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 441/888] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:38.520143 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:38.642552 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c61eae-c88c-45ac-b52a-37402e561882 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:38.679133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:38.679930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:38.680229 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:38.680475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:38.681392 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:38.681697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:38.683332 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:38.686420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:38.704147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 448/889] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 3 20:35:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:38.710546 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:38.818763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0a955-207c-49ac-a7e1-65b526884b05 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:38.855286 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:38.855903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:38.856171 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:38.856432 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:38.868289 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:38.869763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:38.884745 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:38.889035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:38.890202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:38.890202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:38.890202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:38.890202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 442/890] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:38.891631 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:38.994861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e21a-b594-4dda-bf2a-dbf9921191ed None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:39.033108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:39.033720 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:39.033980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:39.034248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:39.034884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:39.035181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:39.036560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:39.047908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 449/891] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:35:39.054352 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:39.096755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:39.169123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2feb0-e54c-4ff0-a8ab-693c68e2aad7 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:39.204857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:39.205506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:39.205783 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:39.206051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:39.213029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:39.214494 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:35:39.225832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:39.227108 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:39.228407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 443/892] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:39.236595 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:39.305298 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:39.350773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410246cb-541b-4260-9735-72aded45a5ff None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:39.389625 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:39.390386 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:39.390802 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:39.391158 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:39.392172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:39.392481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:39.393995 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bca225-f839-4ce1-9fd7-4279872827cd None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:39.406943 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 450/893] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:39.413949 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:39.509000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:39.520344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521cf21-f3ef-434c-a660-588338c70bd3 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:39.556186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab1fec-a2e8-4a68-9534-594c69917043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:39.556875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab1fec-a2e8-4a68-9534-594c69917043 None admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:39.557141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab1fec-a2e8-4a68-9534-594c69917043 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:39.557417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab1fec-a2e8-4a68-9534-594c69917043 None admin] PATH_INFO: `/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/abb0c39276f6470b92b022e1ea3ebc88/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:39.559426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab1fec-a2e8-4a68-9534-594c69917043 None admin] RBAC: Authorizing `identity:create_grant(project_id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user_id=abb0c39276f6470b92b022e1ea3ebc88, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:39.560869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab1fec-a2e8-4a68-9534-594c69917043 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:39.577637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 444/894] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Sep 3 20:35:39 2022] PUT /identity/v3/projects/7b8683ad46dc4d7f8a4d1d52c90e3f81/users/abb0c39276f6470b92b022e1ea3ebc88/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:35:41.750996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df37b-877c-4f25-8630-2d85d9856e33 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:41.751566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df37b-877c-4f25-8630-2d85d9856e33 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:41.751566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48df37b-877c-4f25-8630-2d85d9856e33 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:41.752936 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 451/895] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:41.758639 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:41.759129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:41.759129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:41.778660 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:41.779837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:41.853788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 445/896] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:41 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 20:35:42.186928 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48df37b-877c-4f25-8630-2d85d9856e33 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:42.298451 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48df37b-877c-4f25-8630-2d85d9856e33 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:42.315468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:42.344598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:42.345294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:42.345562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:42.345831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:42.356920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 20:35:42.361649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:42.362706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:42.363598 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 452/897] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Sep 3 20:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:42.369814 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:42.476480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:42.497490 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b59007-be2a-43da-95ae-a3b2a5c838f2 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:42.532815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:42.533440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:42.533717 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:42.533993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:42.534637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] RBAC: Adding query filter params (name=admin) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:42.534933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:42.536297 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:42.544510 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 446/898] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Sep 3 20:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:42.554099 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:42.672894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c67569-5df7-4717-83fe-cc2ed2e2a657 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:42.721146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:42.721832 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:42.722258 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:42.722620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:42.736962 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:42.738702 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:42.757020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:42.758894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:42.759799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:42.759799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:42.759799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:42.759799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 453/899] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:42.765048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:42.871328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb918e-5112-4271-8d9a-52a7ffe5f8af None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:42.909373 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:42.910219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:42.910586 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:42.910945 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:42.911910 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:42.912328 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:42.914610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:42.932576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 447/900] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:42.941857 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:42.979608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:43.058371 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2392b-d1aa-45b4-8478-3ce5d226528c None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:43.093338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:43.093953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:43.094228 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:43.094497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:43.102360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:43.103797 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 20:35:43.115016 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:43.116081 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:43.117821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 454/901] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:43.122386 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:43.127398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:43.238149 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f1f9-9000-4ec9-868e-23f2897a1245 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:43.275720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:43.276318 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:43.276595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:43.276876 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:43.277608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:43.277905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:43.279330 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:43.295822 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 448/902] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Sep 3 20:35:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:43.302546 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:43.405287 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:43.421083 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce51b9-d7cc-49c9-ba3a-7667db2d8a69 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:43.456868 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:43.457467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:43.457741 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:43.458014 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:43.530655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:43.532100 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:43.623475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:43.641321 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 455/903] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Sep 3 20:35:43 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 20:35:43.647919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:43.713244 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:43.757829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdab03-9f39-47f0-9493-873cb0a893b0 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:43.796152 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:43.796757 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:43.797088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:43.797349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:43.810704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:43.812965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 20:35:43.837133 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:43.838252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 20:35:43.839332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 20:35:43.839332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 20:35:43.839332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:43.839332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 449/904] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:43.846684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:43.956305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6691bf-92f7-4ea2-80ba-ed5407f82216 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:43.992448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:43.993084 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:43.993355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:43.993616 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:43.994248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:43.994541 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:43.995929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:44.007040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 456/905] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Sep 3 20:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:44.013288 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:44.125902 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d7b7-c36b-484e-8d51-e7f13fcb6337 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:44.142944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:44.165211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:44.165847 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:44.166125 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:44.166398 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] PATH_INFO: `/v3/projects/service` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:44.173065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:44.174524 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 20:35:44.186947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:44.187938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: ERROR keystone.server.flask.application Sep 03 20:35:44.188899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 450/906] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Sep 3 20:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:44.196407 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:44.255179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:44.310306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa36ec-5537-4bf0-a7b3-4e90a8f43b62 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:44.347069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:44.347972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:44.348366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:44.348752 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:44.349874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:44.350324 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:44.352567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d2b03-84a4-4299-9f71-c53d74aa0265 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:44.364908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 457/907] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Sep 3 20:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:44.371600 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:44.477979 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb920d4b-0952-406a-92ae-75849bf6100f None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:44.513083 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:44.513605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:44.513884 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:44.514151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:44.514868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] RBAC: Adding query filter params (role.id=a8de70c7e0064d04a6fe974cc4a42ca8, scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81, user.id=abb0c39276f6470b92b022e1ea3ebc88) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:44.515176 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:44.516596 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9105372-ce97-465d-847f-2b082fdc89a5 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:44.523011 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 451/908] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Sep 3 20:35:44 2022] GET /identity/v3/role_assignments?user.id=abb0c39276f6470b92b022e1ea3ebc88&scope.project.id=7b8683ad46dc4d7f8a4d1d52c90e3f81&role.id=a8de70c7e0064d04a6fe974cc4a42ca8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:35:46.877131 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5e3e7-0276-4b0f-80d5-af030e1e4e4c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:46.877733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5e3e7-0276-4b0f-80d5-af030e1e4e4c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:46.877733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5e3e7-0276-4b0f-80d5-af030e1e4e4c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:46.879013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 458/909] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:46.885127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:46.885544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:46.885654 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:46.910196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:46.911389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:46.952363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:46.994874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 452/910] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:47.310463 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5e3e7-0276-4b0f-80d5-af030e1e4e4c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:47.430294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5e3e7-0276-4b0f-80d5-af030e1e4e4c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:47.437408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:47.465242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:47.465858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:47.466128 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:47.466394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] PATH_INFO: `/v3/services/placement` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:47.467225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:47.468576 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:47.477574 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:47.478724 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:47.479618 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 459/911] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 3 20:35:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:47.485769 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:47.591658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41399156-aabb-4a8a-b500-905e009e09a7 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:47.630596 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:47.631192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:47.631461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:47.631730 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:47.632356 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:47.632649 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:47.634267 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f77ad-245c-4a6e-99d2-cd7f9de9a282 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:47.639837 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 453/912] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 3 20:35:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:47.647187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:47.762922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba789bf-cf4d-4181-b7da-51e6efd0995b None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:47.797294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:47.797898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:47.798171 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:47.798418 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] PATH_INFO: `/v3/services` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:47.799069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:47.799364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:47.800721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5363e7-43a7-48c4-b325-25c719c8c2e8 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:47.805809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 460/913] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 3 20:35:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:49.960738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf004d-36fb-4f5b-85df-ea4f49e49016 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:49.961413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf004d-36fb-4f5b-85df-ea4f49e49016 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:49.961585 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf004d-36fb-4f5b-85df-ea4f49e49016 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:49.963026 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 454/914] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:49.968613 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c4b0-b5c7-4565-b148-dc796bb0cbf2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:49.969055 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c4b0-b5c7-4565-b148-dc796bb0cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:49.969197 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c4b0-b5c7-4565-b148-dc796bb0cbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:49.990705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-4140c4b0-b5c7-4565-b148-dc796bb0cbf2 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:49.991895 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-4140c4b0-b5c7-4565-b148-dc796bb0cbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:50.021943 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:50.068333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 461/915] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:50.388354 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf004d-36fb-4f5b-85df-ea4f49e49016 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:50.425720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:50.505795 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf004d-36fb-4f5b-85df-ea4f49e49016 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:50.546079 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a809a6-3e93-4d1b-9e0a-6922e7618d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:50.546675 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a809a6-3e93-4d1b-9e0a-6922e7618d54 None admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:50.546948 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a809a6-3e93-4d1b-9e0a-6922e7618d54 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:50.547211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a809a6-3e93-4d1b-9e0a-6922e7618d54 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:50.547850 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a809a6-3e93-4d1b-9e0a-6922e7618d54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:50.549242 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a809a6-3e93-4d1b-9e0a-6922e7618d54 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:50.572619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 455/916] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Sep 3 20:35:50 2022] POST /identity/v3/services => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:35:52.743305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce75e3-d5e3-44e7-8f40-beceb888edd6 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:52.744184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce75e3-d5e3-44e7-8f40-beceb888edd6 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:52.744184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce75e3-d5e3-44e7-8f40-beceb888edd6 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:52.746359 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 462/917] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:52.754196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165cf97-078b-44d6-9166-53546f083139 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:52.754643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165cf97-078b-44d6-9166-53546f083139 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:52.754738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165cf97-078b-44d6-9166-53546f083139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:52.775119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-7165cf97-078b-44d6-9166-53546f083139 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:52.776285 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-7165cf97-078b-44d6-9166-53546f083139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:52.863754 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 456/918] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:52 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:53.197974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce75e3-d5e3-44e7-8f40-beceb888edd6 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:53.311466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce75e3-d5e3-44e7-8f40-beceb888edd6 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:53.347722 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:53.348338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:53.348619 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:53.348873 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:53.349481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:53.350851 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:53.359686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:53.360821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:53.362064 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 463/919] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 3 20:35:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:53.367571 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165cf97-078b-44d6-9166-53546f083139 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:53.393317 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:53.494972 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165cf97-078b-44d6-9166-53546f083139 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:53.532320 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:53.532935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:53.533209 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:53.533473 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:53.534094 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:53.534391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:53.535746 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:53.541197 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 457/920] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 3 20:35:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:35:53.547398 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:53.578222 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:53.651634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf8ebe-4503-4c69-a8c2-4e22b6bcf7fc None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:53.687523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:53.688130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:53.688406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:53.688674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:53.689414 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] RBAC: Adding query filter params (interface=public, service_id=0f45213e1a2e42c6838aff5edf1082d8, region_id=RegionOne) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:53.689719 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:53.691097 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46df31a-bb57-4e6a-b09a-0c2293b9f6c7 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:53.696246 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 464/921] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Sep 3 20:35:53 2022] GET /identity/v3/endpoints?service_id=0f45213e1a2e42c6838aff5edf1082d8&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:53.702381 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:53.791088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:53.811003 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5b038-17a2-4bc8-ac49-68604048dea7 None admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:53.846324 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826f2e1-0110-476b-af74-6f1a4086238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:53.846917 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826f2e1-0110-476b-af74-6f1a4086238d None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:53.847191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826f2e1-0110-476b-af74-6f1a4086238d None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:53.847462 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826f2e1-0110-476b-af74-6f1a4086238d None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:53.848065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826f2e1-0110-476b-af74-6f1a4086238d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:53.849468 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826f2e1-0110-476b-af74-6f1a4086238d None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:53.856028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 458/922] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Sep 3 20:35:53 2022] GET /identity/v3/services => generated 1962 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:35:56.079811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558ca04-bfa0-49bf-96f4-ee4bd9bc059c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:56.080380 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558ca04-bfa0-49bf-96f4-ee4bd9bc059c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:56.080380 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558ca04-bfa0-49bf-96f4-ee4bd9bc059c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:56.081742 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 465/923] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:35:56.087918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:56.088608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:56.088813 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:56.113813 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:35:56.115015 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:35:56.191222 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 459/924] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:35:56 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 20:35:56.514846 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558ca04-bfa0-49bf-96f4-ee4bd9bc059c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:56.615486 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:56.627791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558ca04-bfa0-49bf-96f4-ee4bd9bc059c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:56.666218 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:56.666847 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:56.667122 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:56.667387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:56.667962 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:56.669368 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 20:35:56.678247 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 20:35:56.679355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application with Lock( Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self._enter() Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application return self.creator() Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application created_value = creator( Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: ERROR keystone.server.flask.application Sep 03 20:35:56.680653 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 466/925] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Sep 3 20:35:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 20:35:56.686576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:56.791097 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:35:56.815166 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557dd75-6b27-499b-8663-30e681037ac6 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:56.849353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:56.849959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:56.850239 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:56.850508 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] PATH_INFO: `/v3/services` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:56.851132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:35:56.851432 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:56.852876 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f53f64-4c7b-4241-aeb8-42aceed4e403 None admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:56.858027 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 460/926] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Sep 3 20:35:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:35:56.864144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:35:56.983715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a2ca-744d-4db1-9102-51234797e4f0 None admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:35:57.021225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c21a2-3c89-4d62-9382-21abd7daefc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:35:57.021831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c21a2-3c89-4d62-9382-21abd7daefc0 None admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:35:57.022101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c21a2-3c89-4d62-9382-21abd7daefc0 None admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:35:57.022370 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c21a2-3c89-4d62-9382-21abd7daefc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:35:57.023038 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c21a2-3c89-4d62-9382-21abd7daefc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:35:57.024468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c21a2-3c89-4d62-9382-21abd7daefc0 None admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:35:57.047114 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 467/927] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:35:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:36:06.854981 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=30 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:36:07.042233 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:36:57.637869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f23b43-871f-44f9-8001-9214b9b6dba9 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:36:57.638440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f23b43-871f-44f9-8001-9214b9b6dba9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:36:57.638440 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f23b43-871f-44f9-8001-9214b9b6dba9 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:36:57.643753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 461/928] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:36:57.645486 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62bad-8266-4419-b69a-2ecbb7552bab None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:36:57.646248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62bad-8266-4419-b69a-2ecbb7552bab None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:36:57.646669 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62bad-8266-4419-b69a-2ecbb7552bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:36:57.668821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a1b62bad-8266-4419-b69a-2ecbb7552bab None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:36:57.670193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a1b62bad-8266-4419-b69a-2ecbb7552bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:36:57.777936 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 468/929] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:36:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:36:58.129404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81554ba4-eed8-492c-a8ea-4c27b5c30c49 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:36:58.129404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81554ba4-eed8-492c-a8ea-4c27b5c30c49 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:36:58.129404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81554ba4-eed8-492c-a8ea-4c27b5c30c49 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:36:58.130250 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 462/930] 10.222.0.26 () {54 vars in 965 bytes} [Sat Sep 3 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:36:58.136007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e0fd-9cd7-4f79-80ad-6368b5ec9a00 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:36:58.136322 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e0fd-9cd7-4f79-80ad-6368b5ec9a00 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:36:58.136630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5e0fd-9cd7-4f79-80ad-6368b5ec9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:36:58.205777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-fcb5e0fd-9cd7-4f79-80ad-6368b5ec9a00 None None] MFA Rules not processed for user `0a022837bc064674a9b648976e37f9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:36:58.207069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-fcb5e0fd-9cd7-4f79-80ad-6368b5ec9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:36:58.271140 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 469/931] 10.222.0.26 () {58 vars in 1062 bytes} [Sat Sep 3 20:36:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 20:36:58.280606 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81554ba4-eed8-492c-a8ea-4c27b5c30c49 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:36:58.291736 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81554ba4-eed8-492c-a8ea-4c27b5c30c49 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:36:58.295411 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df3756-352a-4584-acf7-478f90a91cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:36:58.296113 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df3756-352a-4584-acf7-478f90a91cac service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:36:58.296509 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df3756-352a-4584-acf7-478f90a91cac service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:36:58.296928 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df3756-352a-4584-acf7-478f90a91cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:36:58.306710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df3756-352a-4584-acf7-478f90a91cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:36:58.308904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df3756-352a-4584-acf7-478f90a91cac service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:36:58.319733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 463/932] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:36:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:00.814034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5262-0458-4bc4-a27d-be0419934747 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:00.814629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5262-0458-4bc4-a27d-be0419934747 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:00.814629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e5262-0458-4bc4-a27d-be0419934747 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:00.815939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 470/933] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:00.821419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac5c00-eafd-427b-be27-4ca681c314ac None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:00.821890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac5c00-eafd-427b-be27-4ca681c314ac None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:00.821972 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac5c00-eafd-427b-be27-4ca681c314ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:00.843530 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-48ac5c00-eafd-427b-be27-4ca681c314ac None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:00.844747 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-48ac5c00-eafd-427b-be27-4ca681c314ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:00.853432 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 464/934] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:01.198649 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5262-0458-4bc4-a27d-be0419934747 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:01.211353 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e5262-0458-4bc4-a27d-be0419934747 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:01.215568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a5243-b2d5-42a2-9c31-37e3388349eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:01.216183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5243-b2d5-42a2-9c31-37e3388349eb service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:01.216479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5243-b2d5-42a2-9c31-37e3388349eb service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:01.216749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a5243-b2d5-42a2-9c31-37e3388349eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:01.227629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a5243-b2d5-42a2-9c31-37e3388349eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:01.229110 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a5243-b2d5-42a2-9c31-37e3388349eb service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:01.240628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 471/935] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:03.774668 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c23a7e-76ea-43be-bb96-fd614e93216d None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:03.775273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c23a7e-76ea-43be-bb96-fd614e93216d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:03.775273 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c23a7e-76ea-43be-bb96-fd614e93216d None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:03.776560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 465/936] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:03.781980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29bb4-ee09-4309-ab0f-e27d7fe56950 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:03.782420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29bb4-ee09-4309-ab0f-e27d7fe56950 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:03.782677 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a29bb4-ee09-4309-ab0f-e27d7fe56950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:03.822833 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-70a29bb4-ee09-4309-ab0f-e27d7fe56950 None None] MFA Rules not processed for user `2e6691a25aef4167ab313743eb7500d4`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:03.824076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-70a29bb4-ee09-4309-ab0f-e27d7fe56950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:03.866431 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:37:03.896664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 472/937] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:03 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:04.247927 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008ecb-86df-43e7-b9fd-df7a2db23ffc None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:04.248213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008ecb-86df-43e7-b9fd-df7a2db23ffc None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:04.248459 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58008ecb-86df-43e7-b9fd-df7a2db23ffc None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:04.249858 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 466/938] 10.222.0.26 () {54 vars in 965 bytes} [Sat Sep 3 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:04.255858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b90d-0618-4e06-9d8c-cf6c8ce85cb2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:04.256146 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b90d-0618-4e06-9d8c-cf6c8ce85cb2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:04.256421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b90d-0618-4e06-9d8c-cf6c8ce85cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:04.278994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-2914b90d-0618-4e06-9d8c-cf6c8ce85cb2 None None] MFA Rules not processed for user `0a022837bc064674a9b648976e37f9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:04.280192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-2914b90d-0618-4e06-9d8c-cf6c8ce85cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:04.288044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 473/939] 10.222.0.26 () {58 vars in 1062 bytes} [Sat Sep 3 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:04.297315 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58008ecb-86df-43e7-b9fd-df7a2db23ffc None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:04.310196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58008ecb-86df-43e7-b9fd-df7a2db23ffc None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:04.314142 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc853b5b-6222-43d7-9d64-5d67f8012026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:04.314748 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853b5b-6222-43d7-9d64-5d67f8012026 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:04.315023 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853b5b-6222-43d7-9d64-5d67f8012026 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:04.315291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc853b5b-6222-43d7-9d64-5d67f8012026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:04.325338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853b5b-6222-43d7-9d64-5d67f8012026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:04.326824 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc853b5b-6222-43d7-9d64-5d67f8012026 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:04.336384 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 467/940] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:07.543145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b353bcf-923e-4d0e-9767-8a35c5812b5a None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:07.544132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b353bcf-923e-4d0e-9767-8a35c5812b5a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:07.544132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b353bcf-923e-4d0e-9767-8a35c5812b5a None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:07.546167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 474/941] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:07.552427 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c5ac-ac12-418e-be7c-1ca9ad0713a4 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:07.553200 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c5ac-ac12-418e-be7c-1ca9ad0713a4 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:07.553331 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95c5ac-ac12-418e-be7c-1ca9ad0713a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:07.577526 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-aa95c5ac-ac12-418e-be7c-1ca9ad0713a4 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:07.578735 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-aa95c5ac-ac12-418e-be7c-1ca9ad0713a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:07.660642 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 468/942] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:08.017095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b353bcf-923e-4d0e-9767-8a35c5812b5a None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:08.035644 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b353bcf-923e-4d0e-9767-8a35c5812b5a None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:08.042355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c0e63-ce54-4fe6-b53a-97a5b9067f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:08.043228 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c0e63-ce54-4fe6-b53a-97a5b9067f93 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:08.043607 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c0e63-ce54-4fe6-b53a-97a5b9067f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:08.043876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c0e63-ce54-4fe6-b53a-97a5b9067f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:08.053148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c0e63-ce54-4fe6-b53a-97a5b9067f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:08.054567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c0e63-ce54-4fe6-b53a-97a5b9067f93 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:08.063877 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 475/943] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:08 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:10.946388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e185-adb3-4406-bec1-4c9f6f21a81b None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:10.947196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e185-adb3-4406-bec1-4c9f6f21a81b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:10.947196 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e185-adb3-4406-bec1-4c9f6f21a81b None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:10.948384 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 469/944] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:10.957868 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169de6-c16a-4141-bd3c-354d06f394ed None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:10.958394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169de6-c16a-4141-bd3c-354d06f394ed None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:10.958394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169de6-c16a-4141-bd3c-354d06f394ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:10.979004 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-6f169de6-c16a-4141-bd3c-354d06f394ed None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:10.980268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-6f169de6-c16a-4141-bd3c-354d06f394ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:10.989586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 476/945] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:11.329595 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428e185-adb3-4406-bec1-4c9f6f21a81b None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:11.341862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428e185-adb3-4406-bec1-4c9f6f21a81b None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:11.345864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed71c9-2354-4b7c-b298-cc4d6c286119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:11.346469 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed71c9-2354-4b7c-b298-cc4d6c286119 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:11.346743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed71c9-2354-4b7c-b298-cc4d6c286119 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:11.347018 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed71c9-2354-4b7c-b298-cc4d6c286119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:11.355938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed71c9-2354-4b7c-b298-cc4d6c286119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:11.357435 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed71c9-2354-4b7c-b298-cc4d6c286119 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:11.367241 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 470/946] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:13.614425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84251ea0-f51c-4157-862e-45b22c4954c3 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:13.614998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84251ea0-f51c-4157-862e-45b22c4954c3 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:13.614998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84251ea0-f51c-4157-862e-45b22c4954c3 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:13.616410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 477/947] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:13.622213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b745cc-92df-4d2f-9dc1-14b4d90a308e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:13.622622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b745cc-92df-4d2f-9dc1-14b4d90a308e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:13.622794 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b745cc-92df-4d2f-9dc1-14b4d90a308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:13.644069 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-38b745cc-92df-4d2f-9dc1-14b4d90a308e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:13.645305 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-38b745cc-92df-4d2f-9dc1-14b4d90a308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:13.654946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 471/948] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:14.007929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84251ea0-f51c-4157-862e-45b22c4954c3 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:14.019865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84251ea0-f51c-4157-862e-45b22c4954c3 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:14.023536 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054492a5-5e81-4707-9f06-3abcc6c89ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:14.024130 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054492a5-5e81-4707-9f06-3abcc6c89ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:14.024402 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054492a5-5e81-4707-9f06-3abcc6c89ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:14.024666 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054492a5-5e81-4707-9f06-3abcc6c89ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:14.034318 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054492a5-5e81-4707-9f06-3abcc6c89ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:14.035750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054492a5-5e81-4707-9f06-3abcc6c89ee2 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:14.045870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 478/949] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:16.282717 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045585-1d53-4011-ac8b-f93f5a5a1954 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:16.283296 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045585-1d53-4011-ac8b-f93f5a5a1954 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:16.283296 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99045585-1d53-4011-ac8b-f93f5a5a1954 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:16.284723 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 472/950] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:16.290412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21390c0-34ff-4031-9ba1-9e38993b9ccc None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:16.290949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21390c0-34ff-4031-9ba1-9e38993b9ccc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:16.290949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21390c0-34ff-4031-9ba1-9e38993b9ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:16.314869 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b21390c0-34ff-4031-9ba1-9e38993b9ccc None None] MFA Rules not processed for user `2e6691a25aef4167ab313743eb7500d4`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:16.316731 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b21390c0-34ff-4031-9ba1-9e38993b9ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:16.328185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 479/951] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:16 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:16.662576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99045585-1d53-4011-ac8b-f93f5a5a1954 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:16.674364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99045585-1d53-4011-ac8b-f93f5a5a1954 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:16.678143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232564e-e03c-4f04-afe2-bcb857459ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:16.678739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232564e-e03c-4f04-afe2-bcb857459ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:16.679012 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232564e-e03c-4f04-afe2-bcb857459ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:16.679309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232564e-e03c-4f04-afe2-bcb857459ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:16.689381 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232564e-e03c-4f04-afe2-bcb857459ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:16.690821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232564e-e03c-4f04-afe2-bcb857459ad1 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:16.700419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 473/952] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:16 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:19.133057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d84d86-9f1e-43ce-bbc6-27f7ad6cff4d None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:19.133501 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d84d86-9f1e-43ce-bbc6-27f7ad6cff4d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:19.133617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d84d86-9f1e-43ce-bbc6-27f7ad6cff4d None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:19.134946 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 480/953] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:19.140722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53947-6605-4fb2-9e94-b49b6aed4aad None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:19.141232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53947-6605-4fb2-9e94-b49b6aed4aad None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:19.141340 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba53947-6605-4fb2-9e94-b49b6aed4aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:19.161960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6ba53947-6605-4fb2-9e94-b49b6aed4aad None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:19.163145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6ba53947-6605-4fb2-9e94-b49b6aed4aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:19.171567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 474/954] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:19.509502 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d84d86-9f1e-43ce-bbc6-27f7ad6cff4d None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:19.521933 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d84d86-9f1e-43ce-bbc6-27f7ad6cff4d None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:19.526261 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431b579-eb24-4d56-bfa5-7c275eeb2dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:19.526828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b579-eb24-4d56-bfa5-7c275eeb2dae service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:19.527106 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b579-eb24-4d56-bfa5-7c275eeb2dae service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:19.527459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431b579-eb24-4d56-bfa5-7c275eeb2dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:19.536311 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b579-eb24-4d56-bfa5-7c275eeb2dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:19.537773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431b579-eb24-4d56-bfa5-7c275eeb2dae service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:19.547620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 481/955] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:21.790885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76b722-7e4e-463a-862c-9fb130a90fd2 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:21.791437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76b722-7e4e-463a-862c-9fb130a90fd2 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:21.791437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76b722-7e4e-463a-862c-9fb130a90fd2 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:21.792661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 475/956] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:21.798132 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892bfa-facd-4b62-be8b-9734626384c5 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:21.798543 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892bfa-facd-4b62-be8b-9734626384c5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:21.798775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892bfa-facd-4b62-be8b-9734626384c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:21.819216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-67892bfa-facd-4b62-be8b-9734626384c5 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:21.820395 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-67892bfa-facd-4b62-be8b-9734626384c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:21.829938 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 482/957] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:22.163335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76b722-7e4e-463a-862c-9fb130a90fd2 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:22.175248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76b722-7e4e-463a-862c-9fb130a90fd2 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:22.179066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56267-6345-448f-93e0-2dc967d859ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:22.179608 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56267-6345-448f-93e0-2dc967d859ce service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:22.179881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56267-6345-448f-93e0-2dc967d859ce service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:22.180147 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56267-6345-448f-93e0-2dc967d859ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:22.190257 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56267-6345-448f-93e0-2dc967d859ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:22.191674 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56267-6345-448f-93e0-2dc967d859ce service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:22.201900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 476/958] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:24.855045 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c153d9-56fe-494d-962e-a636cc28ee2a None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:24.855647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c153d9-56fe-494d-962e-a636cc28ee2a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:24.855647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c153d9-56fe-494d-962e-a636cc28ee2a None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:24.857003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 483/959] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:24.862179 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c42a-4705-4b42-a246-78572e9ef097 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:24.862601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c42a-4705-4b42-a246-78572e9ef097 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:24.862711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0c42a-4705-4b42-a246-78572e9ef097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:24.883646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-aaf0c42a-4705-4b42-a246-78572e9ef097 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:24.884810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-aaf0c42a-4705-4b42-a246-78572e9ef097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:24.894214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 477/960] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:24 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:25.232282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c153d9-56fe-494d-962e-a636cc28ee2a None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:25.245212 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c153d9-56fe-494d-962e-a636cc28ee2a None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:25.249863 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928bda-1973-4910-845c-7956b7f38c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:25.250456 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928bda-1973-4910-845c-7956b7f38c6c service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:25.250726 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928bda-1973-4910-845c-7956b7f38c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:25.250994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928bda-1973-4910-845c-7956b7f38c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:25.260272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928bda-1973-4910-845c-7956b7f38c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:25.261862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed928bda-1973-4910-845c-7956b7f38c6c service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:25.272504 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 484/961] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:25 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:29.449103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c687-22c2-4c99-9674-343d465c5d11 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:29.449624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c687-22c2-4c99-9674-343d465c5d11 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:29.449624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c687-22c2-4c99-9674-343d465c5d11 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:29.451621 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 478/962] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:29.456908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd452-df66-4770-a639-840da9d868c7 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:29.457348 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd452-df66-4770-a639-840da9d868c7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:29.457449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd452-df66-4770-a639-840da9d868c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:29.477621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a4edd452-df66-4770-a639-840da9d868c7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:29.478794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a4edd452-df66-4770-a639-840da9d868c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:29.486954 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 485/963] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:29.828410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846c687-22c2-4c99-9674-343d465c5d11 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:29.834205 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=74 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:37:29.840671 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846c687-22c2-4c99-9674-343d465c5d11 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:29.844661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec899c-04df-4242-88e0-d07c02fd4ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:29.845298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec899c-04df-4242-88e0-d07c02fd4ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:29.845572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec899c-04df-4242-88e0-d07c02fd4ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:29.845838 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec899c-04df-4242-88e0-d07c02fd4ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:29.856089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec899c-04df-4242-88e0-d07c02fd4ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:29.857888 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec899c-04df-4242-88e0-d07c02fd4ce3 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:29.868623 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 479/964] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:32.643704 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19b77-87c6-48f2-ac07-5967b4970c7b None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:32.644273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19b77-87c6-48f2-ac07-5967b4970c7b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:32.644273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19b77-87c6-48f2-ac07-5967b4970c7b None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:32.645545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 486/965] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:32.650823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd3a0-21fb-45f2-ad05-b13f4ca3f872 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:32.651243 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd3a0-21fb-45f2-ad05-b13f4ca3f872 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:32.651486 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd3a0-21fb-45f2-ad05-b13f4ca3f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:32.672325 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-e3bfd3a0-21fb-45f2-ad05-b13f4ca3f872 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:32.673561 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-e3bfd3a0-21fb-45f2-ad05-b13f4ca3f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:32.684883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 480/966] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:32 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:33.029763 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19b77-87c6-48f2-ac07-5967b4970c7b None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:33.041165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19b77-87c6-48f2-ac07-5967b4970c7b None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:33.045254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cd689-4acb-4a69-8b53-f65289267986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:33.045852 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cd689-4acb-4a69-8b53-f65289267986 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:33.046111 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cd689-4acb-4a69-8b53-f65289267986 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:33.046375 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cd689-4acb-4a69-8b53-f65289267986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:33.055818 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cd689-4acb-4a69-8b53-f65289267986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:33.057289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cd689-4acb-4a69-8b53-f65289267986 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:33.067659 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 487/967] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:33 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:37.644001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891575b-a662-4f50-86b1-42bb09c9b119 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:37.644572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891575b-a662-4f50-86b1-42bb09c9b119 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:37.644572 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891575b-a662-4f50-86b1-42bb09c9b119 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:37.645914 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 481/968] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:37.651236 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d5a9-74f9-497f-a1aa-5dff1cf3b99c None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:37.651787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d5a9-74f9-497f-a1aa-5dff1cf3b99c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:37.651787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81d5a9-74f9-497f-a1aa-5dff1cf3b99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:37.659473 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=57 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:37:37.672267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-be81d5a9-74f9-497f-a1aa-5dff1cf3b99c None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:37.673705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-be81d5a9-74f9-497f-a1aa-5dff1cf3b99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:37.682642 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 488/969] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:38.053212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891575b-a662-4f50-86b1-42bb09c9b119 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:38.065511 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891575b-a662-4f50-86b1-42bb09c9b119 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:38.069591 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ddc27-a8a2-4ac6-844c-6a4f55ec94b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:38.070197 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ddc27-a8a2-4ac6-844c-6a4f55ec94b5 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:38.070467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ddc27-a8a2-4ac6-844c-6a4f55ec94b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:38.070735 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ddc27-a8a2-4ac6-844c-6a4f55ec94b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:38.081691 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ddc27-a8a2-4ac6-844c-6a4f55ec94b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:38.083135 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ddc27-a8a2-4ac6-844c-6a4f55ec94b5 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:38.093175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 482/970] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:43.460425 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e327c-e4ef-48f0-b42d-b92ede1696cf None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:43.460931 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e327c-e4ef-48f0-b42d-b92ede1696cf None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:43.461049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e327c-e4ef-48f0-b42d-b92ede1696cf None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:43.462624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 489/971] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:43.469117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467deb-bb4f-45e3-9516-31a953196a6a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:43.469911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467deb-bb4f-45e3-9516-31a953196a6a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:43.470334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd467deb-bb4f-45e3-9516-31a953196a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:43.519819 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-dd467deb-bb4f-45e3-9516-31a953196a6a None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:43.521344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-dd467deb-bb4f-45e3-9516-31a953196a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:43.598256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 483/972] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:37:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:47.668918 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=2 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:37:48.134910 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade5f4e-bd3a-4b85-a51a-9a5071b544bc None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:48.135195 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade5f4e-bd3a-4b85-a51a-9a5071b544bc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:48.135491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade5f4e-bd3a-4b85-a51a-9a5071b544bc None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:48.136873 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 490/973] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:48.142681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0ddc-c4fc-4c6c-b7b4-4c2d151df5a4 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:48.143165 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0ddc-c4fc-4c6c-b7b4-4c2d151df5a4 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:48.143281 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0ddc-c4fc-4c6c-b7b4-4c2d151df5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:48.165375 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-90fd0ddc-c4fc-4c6c-b7b4-4c2d151df5a4 None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:48.166846 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-90fd0ddc-c4fc-4c6c-b7b4-4c2d151df5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:48.178303 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 484/974] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:37:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:49.713180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3d7b-a7ea-42a9-a6fb-08c54733eb7d None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:49.713756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3d7b-a7ea-42a9-a6fb-08c54733eb7d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:49.713756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3d7b-a7ea-42a9-a6fb-08c54733eb7d None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:49.715120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 491/975] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:49.720478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4bb76-04a9-4de7-9aca-526221e8a6b6 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:49.720954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4bb76-04a9-4de7-9aca-526221e8a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:49.721136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4bb76-04a9-4de7-9aca-526221e8a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:49.741829 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-63d4bb76-04a9-4de7-9aca-526221e8a6b6 None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:49.743035 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-63d4bb76-04a9-4de7-9aca-526221e8a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:49.752418 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 485/976] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:37:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:53.770622 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76704c74-780d-4239-acd8-2fce3df9da16 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:53.771507 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76704c74-780d-4239-acd8-2fce3df9da16 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:53.771930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76704c74-780d-4239-acd8-2fce3df9da16 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:53.774063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 492/977] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:37:53.780620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251d550-8063-4026-8328-0f776de87e0e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:53.781175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251d550-8063-4026-8328-0f776de87e0e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:53.781291 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251d550-8063-4026-8328-0f776de87e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:53.817098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-5251d550-8063-4026-8328-0f776de87e0e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:53.818280 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-5251d550-8063-4026-8328-0f776de87e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:53.826536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 486/978] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:54.184952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301985e-107e-41ca-8272-baf131087d33 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:54.185577 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301985e-107e-41ca-8272-baf131087d33 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:54.186051 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301985e-107e-41ca-8272-baf131087d33 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:54.187787 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 493/979] 10.222.0.26 () {54 vars in 962 bytes} [Sat Sep 3 20:37:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:54.197872 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba140a-f631-4cfe-b8f2-20645e70901a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:54.198454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba140a-f631-4cfe-b8f2-20645e70901a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:54.199496 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba140a-f631-4cfe-b8f2-20645e70901a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:54.243111 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-11ba140a-f631-4cfe-b8f2-20645e70901a None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:54.244643 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-11ba140a-f631-4cfe-b8f2-20645e70901a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:54.317177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=100 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:37:54.322526 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 487/980] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Sep 3 20:37:54 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:54.330155 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301985e-107e-41ca-8272-baf131087d33 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:54.344803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301985e-107e-41ca-8272-baf131087d33 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:54.350198 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5cf96-279a-40b1-8184-2072747eecac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:54.350904 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5cf96-279a-40b1-8184-2072747eecac service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:54.351235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5cf96-279a-40b1-8184-2072747eecac service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:54.351562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5cf96-279a-40b1-8184-2072747eecac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:54.360755 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5cf96-279a-40b1-8184-2072747eecac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:54.362545 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5cf96-279a-40b1-8184-2072747eecac service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:54.374531 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 494/981] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:56.846712 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613697-9688-49f3-bfca-037d59a0c96a None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:56.847236 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613697-9688-49f3-bfca-037d59a0c96a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:56.847319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79613697-9688-49f3-bfca-037d59a0c96a None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:56.848755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 488/982] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:56.853989 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d26f8-c0ed-4854-8f29-4952f900fed3 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:56.854438 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d26f8-c0ed-4854-8f29-4952f900fed3 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:56.854522 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d26f8-c0ed-4854-8f29-4952f900fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:56.874281 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-cb1d26f8-c0ed-4854-8f29-4952f900fed3 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:56.875433 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-cb1d26f8-c0ed-4854-8f29-4952f900fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:56.883924 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 495/983] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:37:57.231788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613697-9688-49f3-bfca-037d59a0c96a None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:37:57.245816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79613697-9688-49f3-bfca-037d59a0c96a None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:37:57.250891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3310246-f9a8-4e36-bd85-0c8bf7251dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:37:57.251490 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3310246-f9a8-4e36-bd85-0c8bf7251dd8 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:57.251771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3310246-f9a8-4e36-bd85-0c8bf7251dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:57.252048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3310246-f9a8-4e36-bd85-0c8bf7251dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:57.260755 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3310246-f9a8-4e36-bd85-0c8bf7251dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:37:57.262574 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3310246-f9a8-4e36-bd85-0c8bf7251dd8 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:37:57.274263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 489/984] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:37:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:37:59.794250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffed7a-e5f4-4106-8bed-f038662e216b None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:59.794874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffed7a-e5f4-4106-8bed-f038662e216b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:59.794874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffed7a-e5f4-4106-8bed-f038662e216b None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:59.796023 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 496/985] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:37:59.801450 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face6a8e-4236-44a5-a033-2cce9b2bd153 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:37:59.801926 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face6a8e-4236-44a5-a033-2cce9b2bd153 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:37:59.802033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face6a8e-4236-44a5-a033-2cce9b2bd153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:37:59.822151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-face6a8e-4236-44a5-a033-2cce9b2bd153 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:37:59.823353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-face6a8e-4236-44a5-a033-2cce9b2bd153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:37:59.832174 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 490/986] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:37:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:00.173018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de664d6-29be-4749-ab73-eae60ca266ef None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:00.173561 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de664d6-29be-4749-ab73-eae60ca266ef None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:00.173831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de664d6-29be-4749-ab73-eae60ca266ef None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:00.175206 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 497/987] 10.222.0.26 () {54 vars in 962 bytes} [Sat Sep 3 20:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:00.182067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a874-e232-4a7e-b084-80ec7be02be6 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:00.182348 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a874-e232-4a7e-b084-80ec7be02be6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:00.182620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3a874-e232-4a7e-b084-80ec7be02be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:00.211472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-66d3a874-e232-4a7e-b084-80ec7be02be6 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:00.212686 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-66d3a874-e232-4a7e-b084-80ec7be02be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:00.232998 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 491/988] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Sep 3 20:38:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:00.241089 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de664d6-29be-4749-ab73-eae60ca266ef None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:00.257999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de664d6-29be-4749-ab73-eae60ca266ef None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:00.263619 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36150d-c843-481f-bbda-70113a4013f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:00.264301 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36150d-c843-481f-bbda-70113a4013f9 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:00.264966 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36150d-c843-481f-bbda-70113a4013f9 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:00.265242 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36150d-c843-481f-bbda-70113a4013f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:00.273953 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36150d-c843-481f-bbda-70113a4013f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:00.275553 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36150d-c843-481f-bbda-70113a4013f9 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:00.285676 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 498/989] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:02.588220 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762b98-adb5-4041-8298-8d45bd70eac9 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:02.588786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762b98-adb5-4041-8298-8d45bd70eac9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:02.588786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762b98-adb5-4041-8298-8d45bd70eac9 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:02.590455 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 492/990] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:02.596330 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04e9d-eda2-4c4a-9e97-34bb7cc43f18 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:02.597275 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04e9d-eda2-4c4a-9e97-34bb7cc43f18 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:02.597721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc04e9d-eda2-4c4a-9e97-34bb7cc43f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:02.618996 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-5bc04e9d-eda2-4c4a-9e97-34bb7cc43f18 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:02.629999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-5bc04e9d-eda2-4c4a-9e97-34bb7cc43f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:02.647080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:03.019434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762b98-adb5-4041-8298-8d45bd70eac9 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:03.034569 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762b98-adb5-4041-8298-8d45bd70eac9 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:03.040941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74455188-1c18-4bc9-8286-9ada6a7d0389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:03.041720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455188-1c18-4bc9-8286-9ada6a7d0389 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:03.042206 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455188-1c18-4bc9-8286-9ada6a7d0389 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:03.042738 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74455188-1c18-4bc9-8286-9ada6a7d0389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:03.052774 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455188-1c18-4bc9-8286-9ada6a7d0389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:03.054828 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74455188-1c18-4bc9-8286-9ada6a7d0389 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:03.081276 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 493/992] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:04.173089 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180019c1-d562-4592-b877-0c2822f351b8 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:04.173593 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180019c1-d562-4592-b877-0c2822f351b8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:04.173678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180019c1-d562-4592-b877-0c2822f351b8 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:04.175255 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 500/993] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:04.182948 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a355-43ec-41ac-aaf6-f32f818926ec None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:04.184646 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a355-43ec-41ac-aaf6-f32f818926ec None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:04.185210 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171a355-43ec-41ac-aaf6-f32f818926ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:04.212457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-d171a355-43ec-41ac-aaf6-f32f818926ec None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:04.214157 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-d171a355-43ec-41ac-aaf6-f32f818926ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:04.227579 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 494/994] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:04.830288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579e883-5638-45c1-baaa-78f02eeb65f3 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:04.830288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579e883-5638-45c1-baaa-78f02eeb65f3 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:04.830288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579e883-5638-45c1-baaa-78f02eeb65f3 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:04.832775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 501/995] 10.222.0.26 () {54 vars in 964 bytes} [Sat Sep 3 20:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:04.836248 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a6a4e-fda6-4a1d-a079-017c681eba13 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:04.836532 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a6a4e-fda6-4a1d-a079-017c681eba13 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:04.836800 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a6a4e-fda6-4a1d-a079-017c681eba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:04.874369 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-726a6a4e-fda6-4a1d-a079-017c681eba13 None None] MFA Rules not processed for user `c1da13ce94a741168b0e6d09bf9342e4`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:04.875565 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-726a6a4e-fda6-4a1d-a079-017c681eba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:04.941675 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 495/996] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Sep 3 20:38:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:04.948982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579e883-5638-45c1-baaa-78f02eeb65f3 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:04.959943 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579e883-5638-45c1-baaa-78f02eeb65f3 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:04.963374 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4f614-77fa-4273-9821-ba6215c7cd14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1da13ce94a741168b0e6d09bf9342e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:04.963969 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4f614-77fa-4273-9821-ba6215c7cd14 service cinder] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:04.964223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4f614-77fa-4273-9821-ba6215c7cd14 service cinder] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:04.964745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4f614-77fa-4273-9821-ba6215c7cd14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:04.974601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4f614-77fa-4273-9821-ba6215c7cd14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:04.976131 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4f614-77fa-4273-9821-ba6215c7cd14 service cinder] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:04.986693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 502/997] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:05.401692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adb10-334a-456e-9569-92fd7cfc2445 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:05.402246 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adb10-334a-456e-9569-92fd7cfc2445 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:05.402444 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5adb10-334a-456e-9569-92fd7cfc2445 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:05.403810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 496/998] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:05.409157 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e9da-4ef5-449b-8d0a-314647d1fd49 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:05.409990 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e9da-4ef5-449b-8d0a-314647d1fd49 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:05.410446 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8e9da-4ef5-449b-8d0a-314647d1fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:05.430373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-55f8e9da-4ef5-449b-8d0a-314647d1fd49 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:05.431788 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-55f8e9da-4ef5-449b-8d0a-314647d1fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:05.440272 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 503/999] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:05.792278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adb10-334a-456e-9569-92fd7cfc2445 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:05.812129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5adb10-334a-456e-9569-92fd7cfc2445 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:05.823363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4a89-591c-4d33-bc5e-f0ebf55227de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:05.823363 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4a89-591c-4d33-bc5e-f0ebf55227de service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:05.829687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4a89-591c-4d33-bc5e-f0ebf55227de service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:05.830739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4a89-591c-4d33-bc5e-f0ebf55227de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:05.847390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f4a89-591c-4d33-bc5e-f0ebf55227de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:05.849432 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f4a89-591c-4d33-bc5e-f0ebf55227de service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:05.860365 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 497/1000] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:08.116731 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8b81-b7c3-48ef-83b6-edebeee02757 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:08.117417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8b81-b7c3-48ef-83b6-edebeee02757 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:08.117417 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf8b81-b7c3-48ef-83b6-edebeee02757 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:08.118658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 504/1001] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:08.125441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45531f99-a699-4264-b9d3-80bb33b32e2a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:08.125441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45531f99-a699-4264-b9d3-80bb33b32e2a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:08.125441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45531f99-a699-4264-b9d3-80bb33b32e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:08.145234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-45531f99-a699-4264-b9d3-80bb33b32e2a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:08.146413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-45531f99-a699-4264-b9d3-80bb33b32e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:08.155975 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 498/1002] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:08.494807 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf8b81-b7c3-48ef-83b6-edebeee02757 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:08.509673 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf8b81-b7c3-48ef-83b6-edebeee02757 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:08.515330 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b636c-80df-4e74-a9d6-1f506ac8f2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:08.515998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b636c-80df-4e74-a9d6-1f506ac8f2dd service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:08.516209 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b636c-80df-4e74-a9d6-1f506ac8f2dd service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:08.516443 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b636c-80df-4e74-a9d6-1f506ac8f2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:08.525486 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b636c-80df-4e74-a9d6-1f506ac8f2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:08.527068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b636c-80df-4e74-a9d6-1f506ac8f2dd service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:08.536863 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 505/1003] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:10.799965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b708-5895-4a46-aacc-e15779faea43 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:10.800568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b708-5895-4a46-aacc-e15779faea43 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:10.800568 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b708-5895-4a46-aacc-e15779faea43 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:10.801993 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 499/1004] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:10.808161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9917-fde0-43a5-b456-a7d5ba9183c4 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:10.808775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9917-fde0-43a5-b456-a7d5ba9183c4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:10.808775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c9917-fde0-43a5-b456-a7d5ba9183c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:10.830629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-950c9917-fde0-43a5-b456-a7d5ba9183c4 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:10.831850 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-950c9917-fde0-43a5-b456-a7d5ba9183c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:10.841320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 506/1005] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:11.184150 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b708-5895-4a46-aacc-e15779faea43 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:11.199414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b708-5895-4a46-aacc-e15779faea43 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:11.205201 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9422-4894-4f7d-8cca-6eb0761808f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:11.205941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9422-4894-4f7d-8cca-6eb0761808f0 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:11.206222 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9422-4894-4f7d-8cca-6eb0761808f0 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:11.206491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9422-4894-4f7d-8cca-6eb0761808f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:11.216229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9422-4894-4f7d-8cca-6eb0761808f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:11.217900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9422-4894-4f7d-8cca-6eb0761808f0 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:11.228718 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 500/1006] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:13.414946 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8551af-a2c8-443c-8b89-e3c3e6579ebf None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:13.415630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8551af-a2c8-443c-8b89-e3c3e6579ebf None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:13.415630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8551af-a2c8-443c-8b89-e3c3e6579ebf None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:13.416853 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 507/1007] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:38:13.422399 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174ef3-efd0-4050-93db-5115ef4cea6d None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:13.423006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174ef3-efd0-4050-93db-5115ef4cea6d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:13.423006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d174ef3-efd0-4050-93db-5115ef4cea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:13.446868 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-0d174ef3-efd0-4050-93db-5115ef4cea6d None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:13.448624 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-0d174ef3-efd0-4050-93db-5115ef4cea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:13.458546 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 501/1008] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:13.894829 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8551af-a2c8-443c-8b89-e3c3e6579ebf None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:13.911416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8551af-a2c8-443c-8b89-e3c3e6579ebf None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:13.918086 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f04f96-8d20-41ce-be06-1c58a22097a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:13.918680 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04f96-8d20-41ce-be06-1c58a22097a7 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:13.918948 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04f96-8d20-41ce-be06-1c58a22097a7 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:13.919214 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f04f96-8d20-41ce-be06-1c58a22097a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:13.927817 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04f96-8d20-41ce-be06-1c58a22097a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:13.929433 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f04f96-8d20-41ce-be06-1c58a22097a7 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:13.939028 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 508/1009] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:16.268125 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbf332-c6ba-424f-b324-304249664cc3 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:16.269015 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbf332-c6ba-424f-b324-304249664cc3 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:16.269015 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbf332-c6ba-424f-b324-304249664cc3 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:16.270062 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 502/1010] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:38:16.275775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bddf1-fc9f-4398-b8df-239865643dd4 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:16.276350 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bddf1-fc9f-4398-b8df-239865643dd4 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:16.276460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bddf1-fc9f-4398-b8df-239865643dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:16.299798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a12bddf1-fc9f-4398-b8df-239865643dd4 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:16.301063 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a12bddf1-fc9f-4398-b8df-239865643dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:16.310992 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 509/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:16.798044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbf332-c6ba-424f-b324-304249664cc3 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:16.813299 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbf332-c6ba-424f-b324-304249664cc3 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:16.818634 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b176cd5-de79-42c9-879d-e34ea93b355f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:16.819298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176cd5-de79-42c9-879d-e34ea93b355f service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:16.819576 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176cd5-de79-42c9-879d-e34ea93b355f service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:16.819846 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b176cd5-de79-42c9-879d-e34ea93b355f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:16.829359 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176cd5-de79-42c9-879d-e34ea93b355f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:16.830900 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b176cd5-de79-42c9-879d-e34ea93b355f service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:16.840790 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 503/1012] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:38:19.843187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4c566-d194-4a6e-8956-87c00d869deb None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:19.843876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4c566-d194-4a6e-8956-87c00d869deb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:19.843876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4c566-d194-4a6e-8956-87c00d869deb None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:19.845077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 510/1013] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:19.851564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a474d5-7625-429f-8a24-da889a0d2e67 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:19.851564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a474d5-7625-429f-8a24-da889a0d2e67 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:19.851564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a474d5-7625-429f-8a24-da889a0d2e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:19.879527 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-c8a474d5-7625-429f-8a24-da889a0d2e67 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:19.880729 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-c8a474d5-7625-429f-8a24-da889a0d2e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:19.890151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 504/1014] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:20.234000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4c566-d194-4a6e-8956-87c00d869deb None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:20.241707 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=46 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:38:20.249442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4c566-d194-4a6e-8956-87c00d869deb None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:20.255362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735e309-0676-44f3-b622-f787dc83ca74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:20.255985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735e309-0676-44f3-b622-f787dc83ca74 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:20.256256 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735e309-0676-44f3-b622-f787dc83ca74 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:20.256519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735e309-0676-44f3-b622-f787dc83ca74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:20.265634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735e309-0676-44f3-b622-f787dc83ca74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:20.267227 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735e309-0676-44f3-b622-f787dc83ca74 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:20.276698 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 511/1015] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:21.050214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77084-ce72-4d3b-830f-384857626868 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:21.058619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77084-ce72-4d3b-830f-384857626868 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:21.058619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77084-ce72-4d3b-830f-384857626868 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:21.058619 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 505/1016] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:21.058915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896d196-5b57-4555-bec9-829d8b57d4ac None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:21.058915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896d196-5b57-4555-bec9-829d8b57d4ac None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:21.058915 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896d196-5b57-4555-bec9-829d8b57d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:21.078095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-2896d196-5b57-4555-bec9-829d8b57d4ac None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:21.079326 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-2896d196-5b57-4555-bec9-829d8b57d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:21.088187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 512/1017] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:21.442551 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3d2be-b03e-4a12-8d27-79e840a7ef1f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:21.442901 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3d2be-b03e-4a12-8d27-79e840a7ef1f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:21.443186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3d2be-b03e-4a12-8d27-79e840a7ef1f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:21.444477 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 506/1018] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 3 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:21.449995 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8056743-4acd-4db5-abab-0b5e6e9cd177 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:21.450286 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8056743-4acd-4db5-abab-0b5e6e9cd177 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:21.450586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8056743-4acd-4db5-abab-0b5e6e9cd177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:21.490894 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-e8056743-4acd-4db5-abab-0b5e6e9cd177 None None] MFA Rules not processed for user `ab5edd41adff4d35b34dfa7bad99e4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:21.492095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-e8056743-4acd-4db5-abab-0b5e6e9cd177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:21.557552 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 513/1019] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 3 20:38:21 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:21.565415 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3d2be-b03e-4a12-8d27-79e840a7ef1f None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:21.576791 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3d2be-b03e-4a12-8d27-79e840a7ef1f None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:21.580713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778995b5-9754-4bed-87b8-da1f44c8c1a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5edd41adff4d35b34dfa7bad99e4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:21.581326 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778995b5-9754-4bed-87b8-da1f44c8c1a7 service glance] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:21.581597 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778995b5-9754-4bed-87b8-da1f44c8c1a7 service glance] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:21.581863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778995b5-9754-4bed-87b8-da1f44c8c1a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:21.591121 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778995b5-9754-4bed-87b8-da1f44c8c1a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:21.592541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778995b5-9754-4bed-87b8-da1f44c8c1a7 service glance] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:21.601922 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 507/1020] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:22.521354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5efa9-e047-4951-b402-083deb6e9f3c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:22.521993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5efa9-e047-4951-b402-083deb6e9f3c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:22.521993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5efa9-e047-4951-b402-083deb6e9f3c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:22.523168 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 514/1021] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:22.530651 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9776cdb-25fa-4a22-9300-dd89e6b6cafd None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:22.531610 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9776cdb-25fa-4a22-9300-dd89e6b6cafd None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:22.531959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9776cdb-25fa-4a22-9300-dd89e6b6cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:22.560419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-f9776cdb-25fa-4a22-9300-dd89e6b6cafd None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:22.561870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-f9776cdb-25fa-4a22-9300-dd89e6b6cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:22.570889 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 508/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:22.918311 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5efa9-e047-4951-b402-083deb6e9f3c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:22.934340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5efa9-e047-4951-b402-083deb6e9f3c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:22.940485 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80141123-037b-48fb-b381-ae997ddb5cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:22.941118 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141123-037b-48fb-b381-ae997ddb5cf2 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:22.941397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141123-037b-48fb-b381-ae997ddb5cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:22.941665 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80141123-037b-48fb-b381-ae997ddb5cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:22.954560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80141123-037b-48fb-b381-ae997ddb5cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:22.955296 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80141123-037b-48fb-b381-ae997ddb5cf2 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:22.966264 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 515/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:25.265048 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1563-0478-4757-a35f-33d2497bdefb None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:25.265658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1563-0478-4757-a35f-33d2497bdefb None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:25.265658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea1563-0478-4757-a35f-33d2497bdefb None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:25.267235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 509/1024] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:38:25.272714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f79b-e6d5-4148-86b3-daaba7031c07 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:25.273294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f79b-e6d5-4148-86b3-daaba7031c07 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:25.273294 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f79b-e6d5-4148-86b3-daaba7031c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:25.293629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b336f79b-e6d5-4148-86b3-daaba7031c07 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:25.294834 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b336f79b-e6d5-4148-86b3-daaba7031c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:25.302861 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 516/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:38:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:25.647659 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1563-0478-4757-a35f-33d2497bdefb None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:25.657918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=92 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:38:25.665469 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea1563-0478-4757-a35f-33d2497bdefb None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:25.671768 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54700b2f-0a66-42c8-96ca-123ca87bc577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:25.672382 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54700b2f-0a66-42c8-96ca-123ca87bc577 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:25.672650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54700b2f-0a66-42c8-96ca-123ca87bc577 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:25.672939 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54700b2f-0a66-42c8-96ca-123ca87bc577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:25.682030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54700b2f-0a66-42c8-96ca-123ca87bc577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:25.685982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54700b2f-0a66-42c8-96ca-123ca87bc577 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:25.695770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 510/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:35.288743 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=50 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:38:35.690540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=5 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:38:36.765534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a502-a626-4498-8e93-d2d32ea82201 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:36.766232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a502-a626-4498-8e93-d2d32ea82201 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:36.766232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5a502-a626-4498-8e93-d2d32ea82201 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:36.767414 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 517/1027] 10.222.0.26 () {54 vars in 918 bytes} [Sat Sep 3 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:36.772782 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf254a-205f-4c33-8277-bc0ff24e770e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:36.773289 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf254a-205f-4c33-8277-bc0ff24e770e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:36.773289 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf254a-205f-4c33-8277-bc0ff24e770e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:36.793264 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-1ddf254a-205f-4c33-8277-bc0ff24e770e None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:36.795294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-1ddf254a-205f-4c33-8277-bc0ff24e770e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:36.804571 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 511/1028] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Sep 3 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:36.818944 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be29db-310b-402f-bd75-8615cd0569fa None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:36.819224 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be29db-310b-402f-bd75-8615cd0569fa None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:36.819491 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be29db-310b-402f-bd75-8615cd0569fa None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:36.820878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 518/1029] 10.222.0.26 () {54 vars in 918 bytes} [Sat Sep 3 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:36.826539 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe40744-7a5c-441b-9f98-909d29ac2a79 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:36.827008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe40744-7a5c-441b-9f98-909d29ac2a79 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:36.827454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe40744-7a5c-441b-9f98-909d29ac2a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:36.853140 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-bbe40744-7a5c-441b-9f98-909d29ac2a79 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:36.854454 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-bbe40744-7a5c-441b-9f98-909d29ac2a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:36.864864 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 512/1030] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Sep 3 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:39.596473 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba579c5b-1b0e-4668-8cca-2a438e2585fc None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:39.597426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba579c5b-1b0e-4668-8cca-2a438e2585fc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:39.597426 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba579c5b-1b0e-4668-8cca-2a438e2585fc None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:39.599573 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 519/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:39.605980 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471557-ae3b-4141-bce1-7a55d460436a None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:39.606664 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471557-ae3b-4141-bce1-7a55d460436a None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:39.606664 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5471557-ae3b-4141-bce1-7a55d460436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:39.628329 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-f5471557-ae3b-4141-bce1-7a55d460436a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:39.629558 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-f5471557-ae3b-4141-bce1-7a55d460436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:39.638647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 513/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:38:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:39.990801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba579c5b-1b0e-4668-8cca-2a438e2585fc None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:40.005907 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba579c5b-1b0e-4668-8cca-2a438e2585fc None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:40.012026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da20d8d-dfb0-420f-a1a8-81a1c7c425ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:40.012638 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da20d8d-dfb0-420f-a1a8-81a1c7c425ba service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:40.012950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da20d8d-dfb0-420f-a1a8-81a1c7c425ba service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:40.013219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da20d8d-dfb0-420f-a1a8-81a1c7c425ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:40.022268 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da20d8d-dfb0-420f-a1a8-81a1c7c425ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:40.023864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da20d8d-dfb0-420f-a1a8-81a1c7c425ba service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:40.033565 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 520/1033] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:41.016160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b394851-41f4-4918-8fe2-8061476cb970 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:41.016775 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b394851-41f4-4918-8fe2-8061476cb970 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:41.016775 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b394851-41f4-4918-8fe2-8061476cb970 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:41.018065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 514/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:41.024145 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37554e25-2fa3-466a-910f-cb560e5f13a5 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:41.024648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37554e25-2fa3-466a-910f-cb560e5f13a5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:41.024755 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37554e25-2fa3-466a-910f-cb560e5f13a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:41.052737 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-37554e25-2fa3-466a-910f-cb560e5f13a5 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:41.053989 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-37554e25-2fa3-466a-910f-cb560e5f13a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:41.063469 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 521/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:41.271872 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b394851-41f4-4918-8fe2-8061476cb970 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:41.288797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b394851-41f4-4918-8fe2-8061476cb970 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:41.294061 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4275fc0-de2f-4eee-a416-8de632b57df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:41.294653 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275fc0-de2f-4eee-a416-8de632b57df9 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:41.294926 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275fc0-de2f-4eee-a416-8de632b57df9 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:41.295191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4275fc0-de2f-4eee-a416-8de632b57df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:41.303992 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275fc0-de2f-4eee-a416-8de632b57df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:41.305689 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4275fc0-de2f-4eee-a416-8de632b57df9 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:41.315498 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 515/1036] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:42.231227 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce80e-07d2-4057-874a-96a6f7667b6c None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:42.231831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce80e-07d2-4057-874a-96a6f7667b6c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:42.231831 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce80e-07d2-4057-874a-96a6f7667b6c None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:42.233864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 522/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:42.241556 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e21a4-34b5-4ae7-9f32-530843483e22 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:42.241985 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e21a4-34b5-4ae7-9f32-530843483e22 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:42.242101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e21a4-34b5-4ae7-9f32-530843483e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:42.265625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-342e21a4-34b5-4ae7-9f32-530843483e22 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:42.266849 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-342e21a4-34b5-4ae7-9f32-530843483e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:42.275777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 516/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:42.438065 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce80e-07d2-4057-874a-96a6f7667b6c None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:42.453430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce80e-07d2-4057-874a-96a6f7667b6c None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:42.459172 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060f607-8a0a-4794-816a-fbc62dc769f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:42.459777 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f607-8a0a-4794-816a-fbc62dc769f8 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:42.460020 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f607-8a0a-4794-816a-fbc62dc769f8 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:42.460284 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060f607-8a0a-4794-816a-fbc62dc769f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:42.469151 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060f607-8a0a-4794-816a-fbc62dc769f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:42.470744 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060f607-8a0a-4794-816a-fbc62dc769f8 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:42.480364 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 523/1039] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:38:43.347348 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d541d-6646-4e31-8ca3-15ea5096293f None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:43.348250 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d541d-6646-4e31-8ca3-15ea5096293f None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:43.348250 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d541d-6646-4e31-8ca3-15ea5096293f None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:43.350506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 517/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:43.356692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3cccf-c7d9-46fb-87bd-400a9c87fe62 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:43.357173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3cccf-c7d9-46fb-87bd-400a9c87fe62 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:43.357173 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3cccf-c7d9-46fb-87bd-400a9c87fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:43.380000 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-ece3cccf-c7d9-46fb-87bd-400a9c87fe62 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:43.381971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-ece3cccf-c7d9-46fb-87bd-400a9c87fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:43.395472 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 524/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:43.560778 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d541d-6646-4e31-8ca3-15ea5096293f None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:43.584946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d541d-6646-4e31-8ca3-15ea5096293f None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:43.593316 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752abe9-2aaa-4e99-ba68-bee6ea83dcf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:43.593911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752abe9-2aaa-4e99-ba68-bee6ea83dcf3 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:43.594183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752abe9-2aaa-4e99-ba68-bee6ea83dcf3 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:43.594450 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752abe9-2aaa-4e99-ba68-bee6ea83dcf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:43.604254 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752abe9-2aaa-4e99-ba68-bee6ea83dcf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:43.606732 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752abe9-2aaa-4e99-ba68-bee6ea83dcf3 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:43.622724 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 518/1042] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:44.519226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318522db-0385-4ee4-9a0b-fa9a60e32243 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:44.519801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318522db-0385-4ee4-9a0b-fa9a60e32243 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:44.519801 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318522db-0385-4ee4-9a0b-fa9a60e32243 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:44.521060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 525/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:44.527154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065cc1-9856-42b8-8f8d-7f61f4a8b400 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:44.527966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065cc1-9856-42b8-8f8d-7f61f4a8b400 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:44.528275 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065cc1-9856-42b8-8f8d-7f61f4a8b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:44.556586 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-0f065cc1-9856-42b8-8f8d-7f61f4a8b400 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:44.557872 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-0f065cc1-9856-42b8-8f8d-7f61f4a8b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:44.567919 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 519/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:44.728077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318522db-0385-4ee4-9a0b-fa9a60e32243 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:44.744739 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318522db-0385-4ee4-9a0b-fa9a60e32243 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:44.751093 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e14e6-491b-490b-b807-6f6b3faee447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:44.751686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e14e6-491b-490b-b807-6f6b3faee447 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:44.751957 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e14e6-491b-490b-b807-6f6b3faee447 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:44.752223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e14e6-491b-490b-b807-6f6b3faee447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:44.760412 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e14e6-491b-490b-b807-6f6b3faee447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:44.762127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e14e6-491b-490b-b807-6f6b3faee447 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:44.772004 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 526/1045] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:45.577391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14578d-a0a2-4b13-9e96-a698bc82dada None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:45.577959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14578d-a0a2-4b13-9e96-a698bc82dada None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:45.577959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14578d-a0a2-4b13-9e96-a698bc82dada None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:45.579202 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 520/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:45.585340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23983346-748a-4361-ba18-f1ec55054ff6 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:45.586094 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23983346-748a-4361-ba18-f1ec55054ff6 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:45.586254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23983346-748a-4361-ba18-f1ec55054ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:45.613329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-23983346-748a-4361-ba18-f1ec55054ff6 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:45.614521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-23983346-748a-4361-ba18-f1ec55054ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:45.622277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 527/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:45.775800 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14578d-a0a2-4b13-9e96-a698bc82dada None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:45.791996 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14578d-a0a2-4b13-9e96-a698bc82dada None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:45.798318 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcec667-986b-4f48-9c18-ab12120941c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:45.798899 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcec667-986b-4f48-9c18-ab12120941c8 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:45.799173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcec667-986b-4f48-9c18-ab12120941c8 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:45.799433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcec667-986b-4f48-9c18-ab12120941c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:45.808319 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcec667-986b-4f48-9c18-ab12120941c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:45.810008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcec667-986b-4f48-9c18-ab12120941c8 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:45.819190 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 521/1048] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:46.629680 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b969-4dcd-481d-a87f-8e34fa6283c8 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:46.630253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b969-4dcd-481d-a87f-8e34fa6283c8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:46.630253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5b969-4dcd-481d-a87f-8e34fa6283c8 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:46.631632 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 528/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:46.637660 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63a268-0174-4506-97ce-a029a6e7aeb7 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:46.638194 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63a268-0174-4506-97ce-a029a6e7aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:46.638593 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63a268-0174-4506-97ce-a029a6e7aeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:46.663988 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-4d63a268-0174-4506-97ce-a029a6e7aeb7 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:46.665225 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-4d63a268-0174-4506-97ce-a029a6e7aeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:46.674743 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 522/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:46.835410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b969-4dcd-481d-a87f-8e34fa6283c8 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:46.850940 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5b969-4dcd-481d-a87f-8e34fa6283c8 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:46.857650 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f6a63-38ba-4369-a844-214b3ea0f30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:46.858259 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f6a63-38ba-4369-a844-214b3ea0f30b service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:46.858567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f6a63-38ba-4369-a844-214b3ea0f30b service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:46.858836 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f6a63-38ba-4369-a844-214b3ea0f30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:46.867477 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f6a63-38ba-4369-a844-214b3ea0f30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:46.869120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f6a63-38ba-4369-a844-214b3ea0f30b service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:46.878554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 529/1051] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:47.688437 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998527c-d297-4e65-b798-fe5781f032fa None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:47.689389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998527c-d297-4e65-b798-fe5781f032fa None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:47.689389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998527c-d297-4e65-b798-fe5781f032fa None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:47.691486 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 523/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:47.700031 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ececc-9942-4c3c-86ca-608d061a77a8 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:47.700466 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ececc-9942-4c3c-86ca-608d061a77a8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:47.700572 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ececc-9942-4c3c-86ca-608d061a77a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:47.722360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-df9ececc-9942-4c3c-86ca-608d061a77a8 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:47.723597 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-df9ececc-9942-4c3c-86ca-608d061a77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:47.733105 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 530/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:47.891676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998527c-d297-4e65-b798-fe5781f032fa None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:47.912480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998527c-d297-4e65-b798-fe5781f032fa None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:47.922376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4add64f-b7f5-47ff-80fb-481554981431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:47.923282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add64f-b7f5-47ff-80fb-481554981431 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:47.923707 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add64f-b7f5-47ff-80fb-481554981431 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:47.924129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4add64f-b7f5-47ff-80fb-481554981431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:47.937083 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4add64f-b7f5-47ff-80fb-481554981431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:47.938737 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4add64f-b7f5-47ff-80fb-481554981431 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:47.949219 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 524/1054] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:48.786305 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9350489-690f-42c0-aee3-89636a8b4ca2 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:48.787363 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9350489-690f-42c0-aee3-89636a8b4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:48.787363 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9350489-690f-42c0-aee3-89636a8b4ca2 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:48.789424 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 531/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:38:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:48.797588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7e27-bc32-464e-ab26-2b32d87e94eb None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:48.798060 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7e27-bc32-464e-ab26-2b32d87e94eb None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:48.798172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c7e27-bc32-464e-ab26-2b32d87e94eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:48.823397 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9d2c7e27-bc32-464e-ab26-2b32d87e94eb None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:48.824713 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9d2c7e27-bc32-464e-ab26-2b32d87e94eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:48.833966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 525/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:38:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:49.000059 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9350489-690f-42c0-aee3-89636a8b4ca2 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:49.017153 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9350489-690f-42c0-aee3-89636a8b4ca2 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:49.022369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce63f2-d09b-4bcc-852c-d6186852c592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:49.022963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce63f2-d09b-4bcc-852c-d6186852c592 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:49.023234 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce63f2-d09b-4bcc-852c-d6186852c592 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:49.023500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce63f2-d09b-4bcc-852c-d6186852c592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:49.031958 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce63f2-d09b-4bcc-852c-d6186852c592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:49.033587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce63f2-d09b-4bcc-852c-d6186852c592 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:49.043803 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 532/1057] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:51.178156 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711baf9-ed30-457e-96e0-2ee670ab5cf8 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:51.178664 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711baf9-ed30-457e-96e0-2ee670ab5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:51.178777 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711baf9-ed30-457e-96e0-2ee670ab5cf8 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:51.180531 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 526/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:51.185963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc3b0-9fde-4f50-b6cf-f12c0b9cda7a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:51.186389 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc3b0-9fde-4f50-b6cf-f12c0b9cda7a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:51.186497 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc3b0-9fde-4f50-b6cf-f12c0b9cda7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:51.207161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-f2acc3b0-9fde-4f50-b6cf-f12c0b9cda7a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:51.208387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-f2acc3b0-9fde-4f50-b6cf-f12c0b9cda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:51.217896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 533/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:38:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:51.555246 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711baf9-ed30-457e-96e0-2ee670ab5cf8 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:51.571321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711baf9-ed30-457e-96e0-2ee670ab5cf8 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:51.576856 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad45425-a7bd-4019-9aa2-6875414cbdc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:51.577480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45425-a7bd-4019-9aa2-6875414cbdc1 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:51.577753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45425-a7bd-4019-9aa2-6875414cbdc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:51.578019 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad45425-a7bd-4019-9aa2-6875414cbdc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:51.587493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad45425-a7bd-4019-9aa2-6875414cbdc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:51.588954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad45425-a7bd-4019-9aa2-6875414cbdc1 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:51.598515 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 527/1060] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:38:53.909678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d902a6-4bd2-4a14-9002-1ea17340b55e None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:53.909678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d902a6-4bd2-4a14-9002-1ea17340b55e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:53.909678 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d902a6-4bd2-4a14-9002-1ea17340b55e None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:53.910710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 534/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:53.920399 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad3a11-0c61-4973-a9ce-8de7a4213657 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:53.921080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad3a11-0c61-4973-a9ce-8de7a4213657 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:53.921080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad3a11-0c61-4973-a9ce-8de7a4213657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:53.945028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-42ad3a11-0c61-4973-a9ce-8de7a4213657 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:53.947967 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-42ad3a11-0c61-4973-a9ce-8de7a4213657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:53.956718 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 528/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:38:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:54.307826 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d902a6-4bd2-4a14-9002-1ea17340b55e None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:54.322993 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d902a6-4bd2-4a14-9002-1ea17340b55e None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:54.327317 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f16aa-9ef9-4579-8550-8def986863b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:54.327911 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f16aa-9ef9-4579-8550-8def986863b3 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:54.328183 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f16aa-9ef9-4579-8550-8def986863b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:54.328449 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f16aa-9ef9-4579-8550-8def986863b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:54.337365 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f16aa-9ef9-4579-8550-8def986863b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:54.338791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f16aa-9ef9-4579-8550-8def986863b3 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:54.348419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 535/1063] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:56.978676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a125-752e-4f2e-83fd-979d1463a5db None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:56.979274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a125-752e-4f2e-83fd-979d1463a5db None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:56.979274 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55a125-752e-4f2e-83fd-979d1463a5db None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:56.980592 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 529/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:56.987276 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cddc8-db66-4677-97cc-661a1f7cc65e None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:56.988026 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cddc8-db66-4677-97cc-661a1f7cc65e None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:56.988186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cddc8-db66-4677-97cc-661a1f7cc65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:57.012685 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b56cddc8-db66-4677-97cc-661a1f7cc65e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:57.013995 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b56cddc8-db66-4677-97cc-661a1f7cc65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:57.023986 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 536/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:38:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:38:57.365770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a125-752e-4f2e-83fd-979d1463a5db None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:38:57.385756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55a125-752e-4f2e-83fd-979d1463a5db None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:38:57.391297 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbe27c-b03a-4546-8065-f045585c9b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:38:57.391886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe27c-b03a-4546-8065-f045585c9b67 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:57.392155 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe27c-b03a-4546-8065-f045585c9b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:57.392414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbe27c-b03a-4546-8065-f045585c9b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:57.402294 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbe27c-b03a-4546-8065-f045585c9b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:38:57.403920 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbe27c-b03a-4546-8065-f045585c9b67 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:38:57.413345 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 530/1066] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:38:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:38:59.727668 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde49c9-0c2a-4368-b97f-de2ff966f624 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:59.728520 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde49c9-0c2a-4368-b97f-de2ff966f624 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:59.728520 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde49c9-0c2a-4368-b97f-de2ff966f624 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:59.730819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 537/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:38:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:38:59.736175 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c4e7-7320-4795-8a76-ba5dac3164b8 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:38:59.736626 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c4e7-7320-4795-8a76-ba5dac3164b8 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:38:59.736734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c4e7-7320-4795-8a76-ba5dac3164b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:38:59.757102 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-8076c4e7-7320-4795-8a76-ba5dac3164b8 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:38:59.758309 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-8076c4e7-7320-4795-8a76-ba5dac3164b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:38:59.767517 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 531/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:38:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:00.108884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde49c9-0c2a-4368-b97f-de2ff966f624 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:00.125648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde49c9-0c2a-4368-b97f-de2ff966f624 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:00.130219 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffdd60-1e97-496a-82d3-5de26c7e4e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:00.130835 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffdd60-1e97-496a-82d3-5de26c7e4e8f service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:00.131566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffdd60-1e97-496a-82d3-5de26c7e4e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:00.131566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffdd60-1e97-496a-82d3-5de26c7e4e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:00.142413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffdd60-1e97-496a-82d3-5de26c7e4e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:00.143871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffdd60-1e97-496a-82d3-5de26c7e4e8f service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:00.154198 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 538/1069] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:02.471244 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc8eb-7375-4c3b-abcf-7472639895b7 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:02.471857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc8eb-7375-4c3b-abcf-7472639895b7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:02.471857 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc8eb-7375-4c3b-abcf-7472639895b7 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:02.473072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 532/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:02.479482 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68418-81c0-452c-9e66-4aff0ef3ba63 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:02.480237 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68418-81c0-452c-9e66-4aff0ef3ba63 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:02.480488 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68418-81c0-452c-9e66-4aff0ef3ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:02.512413 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-eab68418-81c0-452c-9e66-4aff0ef3ba63 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:02.513624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-eab68418-81c0-452c-9e66-4aff0ef3ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:02.523113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 539/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:39:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:02.867686 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc8eb-7375-4c3b-abcf-7472639895b7 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:02.881484 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc8eb-7375-4c3b-abcf-7472639895b7 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:02.885665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043be000-5ce4-4c63-9942-6d9176bbbd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:02.886260 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043be000-5ce4-4c63-9942-6d9176bbbd67 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:02.886536 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043be000-5ce4-4c63-9942-6d9176bbbd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:02.886859 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043be000-5ce4-4c63-9942-6d9176bbbd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:02.896635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043be000-5ce4-4c63-9942-6d9176bbbd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:02.898109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043be000-5ce4-4c63-9942-6d9176bbbd67 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:02.908314 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 533/1072] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:05.118318 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a886a-39e0-46df-8f77-470a23ce4177 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:05.118794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a886a-39e0-46df-8f77-470a23ce4177 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:05.118794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a886a-39e0-46df-8f77-470a23ce4177 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:05.120342 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 540/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:05.127163 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c5ab-f2da-494f-aa1b-ad75440949ba None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:05.128191 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c5ab-f2da-494f-aa1b-ad75440949ba None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:05.128641 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c5ab-f2da-494f-aa1b-ad75440949ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:05.150768 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-6890c5ab-f2da-494f-aa1b-ad75440949ba None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:05.151977 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-6890c5ab-f2da-494f-aa1b-ad75440949ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:05.160770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 534/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:39:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:05.506253 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a886a-39e0-46df-8f77-470a23ce4177 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:05.512499 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=64 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:05.519409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a886a-39e0-46df-8f77-470a23ce4177 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:05.522950 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854229ce-4ab2-4b08-84e4-3dc207494ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:05.523539 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854229ce-4ab2-4b08-84e4-3dc207494ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:05.523809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854229ce-4ab2-4b08-84e4-3dc207494ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:05.524073 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854229ce-4ab2-4b08-84e4-3dc207494ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:05.533192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854229ce-4ab2-4b08-84e4-3dc207494ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:05.534623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854229ce-4ab2-4b08-84e4-3dc207494ca1 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:05.544127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 541/1075] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:07.927103 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d7e0-3d0b-4f69-82b7-57e080de6164 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:07.927722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d7e0-3d0b-4f69-82b7-57e080de6164 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:07.927722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d7e0-3d0b-4f69-82b7-57e080de6164 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:07.929052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 535/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:39:07.935613 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915586b5-068e-4951-bcbc-48273a2e8583 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:07.936367 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915586b5-068e-4951-bcbc-48273a2e8583 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:07.936535 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915586b5-068e-4951-bcbc-48273a2e8583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:07.962651 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-915586b5-068e-4951-bcbc-48273a2e8583 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:07.963968 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-915586b5-068e-4951-bcbc-48273a2e8583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:07.973347 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 542/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:39:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:08.334373 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d7e0-3d0b-4f69-82b7-57e080de6164 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:08.340885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=73 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:08.347600 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d7e0-3d0b-4f69-82b7-57e080de6164 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:08.351285 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d51a7-e056-48f2-b981-2b8a54f499fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:08.351883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d51a7-e056-48f2-b981-2b8a54f499fa service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:08.352161 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d51a7-e056-48f2-b981-2b8a54f499fa service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:08.352431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d51a7-e056-48f2-b981-2b8a54f499fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:08.361559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d51a7-e056-48f2-b981-2b8a54f499fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:08.362995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d51a7-e056-48f2-b981-2b8a54f499fa service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:08.372533 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 536/1078] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:10.568319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa93b1f-40e7-4be5-bbd0-1a7707cae907 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:10.568878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa93b1f-40e7-4be5-bbd0-1a7707cae907 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:10.568878 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa93b1f-40e7-4be5-bbd0-1a7707cae907 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:10.570864 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 543/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:39:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:10.579818 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d61102-239d-4762-9a75-80f9072af95b None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:10.580523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d61102-239d-4762-9a75-80f9072af95b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:10.580732 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d61102-239d-4762-9a75-80f9072af95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:10.604966 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-f6d61102-239d-4762-9a75-80f9072af95b None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:10.606164 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-f6d61102-239d-4762-9a75-80f9072af95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:10.615370 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 537/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:39:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:10.960156 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa93b1f-40e7-4be5-bbd0-1a7707cae907 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:10.980566 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa93b1f-40e7-4be5-bbd0-1a7707cae907 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:10.985050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b12ddb-5f74-49dc-bd25-6b1dd23e00e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:10.985650 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12ddb-5f74-49dc-bd25-6b1dd23e00e7 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:10.985985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12ddb-5f74-49dc-bd25-6b1dd23e00e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:10.986287 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12ddb-5f74-49dc-bd25-6b1dd23e00e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:10.996581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b12ddb-5f74-49dc-bd25-6b1dd23e00e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:10.998057 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b12ddb-5f74-49dc-bd25-6b1dd23e00e7 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:11.007705 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 544/1081] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:13.201936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c565f-794e-4956-9b8f-d475a22deb32 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:13.202500 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c565f-794e-4956-9b8f-d475a22deb32 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:13.202500 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c565f-794e-4956-9b8f-d475a22deb32 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:13.203810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 538/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:13.209106 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460cdb7-846f-4142-a5b0-6e08380c7e6c None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:13.209554 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460cdb7-846f-4142-a5b0-6e08380c7e6c None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:13.209664 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460cdb7-846f-4142-a5b0-6e08380c7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:13.229670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-a460cdb7-846f-4142-a5b0-6e08380c7e6c None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:13.230946 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-a460cdb7-846f-4142-a5b0-6e08380c7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:13.239884 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 545/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:39:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:13.573093 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c565f-794e-4956-9b8f-d475a22deb32 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:13.592692 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c565f-794e-4956-9b8f-d475a22deb32 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:13.597214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1d5f5-adb0-4b16-b6a7-87d10e69288e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:13.597815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1d5f5-adb0-4b16-b6a7-87d10e69288e service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:13.598087 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1d5f5-adb0-4b16-b6a7-87d10e69288e service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:13.598355 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1d5f5-adb0-4b16-b6a7-87d10e69288e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:13.607704 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1d5f5-adb0-4b16-b6a7-87d10e69288e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:13.609174 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1d5f5-adb0-4b16-b6a7-87d10e69288e service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:13.618533 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 539/1084] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:15.802896 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe15a9-8bf4-4db8-a00a-ec38e2eea2a6 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:15.803511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe15a9-8bf4-4db8-a00a-ec38e2eea2a6 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:15.803511 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe15a9-8bf4-4db8-a00a-ec38e2eea2a6 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:15.804769 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 546/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:15.811232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777822-8bc7-4e54-af70-be1206516666 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:15.811946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777822-8bc7-4e54-af70-be1206516666 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:15.812064 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67777822-8bc7-4e54-af70-be1206516666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:15.841154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-67777822-8bc7-4e54-af70-be1206516666 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:15.842353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-67777822-8bc7-4e54-af70-be1206516666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:15.851199 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 540/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:39:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:16.197909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe15a9-8bf4-4db8-a00a-ec38e2eea2a6 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:16.211120 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe15a9-8bf4-4db8-a00a-ec38e2eea2a6 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:16.216339 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3279e86-672e-4ec0-9f37-a36aaa2ab9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:16.216980 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279e86-672e-4ec0-9f37-a36aaa2ab9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:16.217260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279e86-672e-4ec0-9f37-a36aaa2ab9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:16.217527 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3279e86-672e-4ec0-9f37-a36aaa2ab9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:16.227166 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3279e86-672e-4ec0-9f37-a36aaa2ab9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:16.228622 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3279e86-672e-4ec0-9f37-a36aaa2ab9d3 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:16.238210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 547/1087] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:25.833067 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=17 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:26.234023 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=23 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:39:40.020467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa42c8-bd39-490f-9d7f-4a9802e1fcdb None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:40.021423 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa42c8-bd39-490f-9d7f-4a9802e1fcdb None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:40.021423 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa42c8-bd39-490f-9d7f-4a9802e1fcdb None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:40.023499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 541/1088] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:40.029139 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99414-5150-45a4-b1ba-e0c4f251cbe1 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:40.029588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99414-5150-45a4-b1ba-e0c4f251cbe1 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:40.029692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd99414-5150-45a4-b1ba-e0c4f251cbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:40.051459 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-1cd99414-5150-45a4-b1ba-e0c4f251cbe1 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:40.052775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-1cd99414-5150-45a4-b1ba-e0c4f251cbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:40.061203 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 548/1089] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:40.423647 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec58f3-97af-409e-98c1-7d8dee2ad819 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:40.424126 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec58f3-97af-409e-98c1-7d8dee2ad819 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:40.424466 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec58f3-97af-409e-98c1-7d8dee2ad819 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:40.426543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 542/1090] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 3 20:39:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:40.432125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4154a-5aed-46a3-a90c-b237e28e4058 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:40.432408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4154a-5aed-46a3-a90c-b237e28e4058 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:40.432667 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4154a-5aed-46a3-a90c-b237e28e4058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:40.453920 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-27a4154a-5aed-46a3-a90c-b237e28e4058 None None] MFA Rules not processed for user `ab5edd41adff4d35b34dfa7bad99e4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:40.455108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-27a4154a-5aed-46a3-a90c-b237e28e4058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:40.462637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 549/1091] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 3 20:39:40 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:40.470231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec58f3-97af-409e-98c1-7d8dee2ad819 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:40.482611 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec58f3-97af-409e-98c1-7d8dee2ad819 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:40.486890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd402-26c9-4c40-8619-be09a4f5ec6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5edd41adff4d35b34dfa7bad99e4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:40.487478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd402-26c9-4c40-8619-be09a4f5ec6f service glance] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:40.487746 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd402-26c9-4c40-8619-be09a4f5ec6f service glance] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:40.488013 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd402-26c9-4c40-8619-be09a4f5ec6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:40.497485 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd402-26c9-4c40-8619-be09a4f5ec6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:40.498914 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd402-26c9-4c40-8619-be09a4f5ec6f service glance] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:40.508229 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 543/1092] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:42.774984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085ebe-1a15-4a6f-afd8-bc1ef43b1ec1 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:42.775581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085ebe-1a15-4a6f-afd8-bc1ef43b1ec1 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:42.775581 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b085ebe-1a15-4a6f-afd8-bc1ef43b1ec1 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:42.777334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 550/1093] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:42.785344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ea7a-3df5-4762-b722-7cc9ae6459ac None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:42.785832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ea7a-3df5-4762-b722-7cc9ae6459ac None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:42.785832 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ea7a-3df5-4762-b722-7cc9ae6459ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:42.805661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-02c5ea7a-3df5-4762-b722-7cc9ae6459ac None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:42.806833 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-02c5ea7a-3df5-4762-b722-7cc9ae6459ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:42.815781 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 544/1094] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 20:39:43.136697 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085ebe-1a15-4a6f-afd8-bc1ef43b1ec1 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:43.152655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b085ebe-1a15-4a6f-afd8-bc1ef43b1ec1 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:43.158524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:43.159187 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:43.159470 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:43.159743 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:43.160387 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:43.162260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:39:43.162260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:39:43.162260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:39:43.163419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afc996-28f6-4704-ac9c-8a0a05caf0b8 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:43.182640 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 551/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Sep 3 20:39:43 2022] GET /identity/v3/projects => generated 1606 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:39:45.376376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860cf9-7eec-496c-9367-012134f7d048 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:45.377271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860cf9-7eec-496c-9367-012134f7d048 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:45.377271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa860cf9-7eec-496c-9367-012134f7d048 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:45.379332 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 545/1096] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:45.387036 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aa63-04d7-4e10-a38b-69fea17cf95b None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:45.387495 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aa63-04d7-4e10-a38b-69fea17cf95b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:45.387599 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749aa63-04d7-4e10-a38b-69fea17cf95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:45.407983 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-0749aa63-04d7-4e10-a38b-69fea17cf95b None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:45.409200 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-0749aa63-04d7-4e10-a38b-69fea17cf95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:45.417744 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 552/1097] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 20:39:45.769491 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860cf9-7eec-496c-9367-012134f7d048 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:45.784059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa860cf9-7eec-496c-9367-012134f7d048 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:45.789290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa912c-9bf7-4221-b15a-d41580d15f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:45.789875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa912c-9bf7-4221-b15a-d41580d15f20 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:45.790149 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa912c-9bf7-4221-b15a-d41580d15f20 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:45.790416 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa912c-9bf7-4221-b15a-d41580d15f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:45.798426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa912c-9bf7-4221-b15a-d41580d15f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:45.800007 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa912c-9bf7-4221-b15a-d41580d15f20 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:45.809173 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 546/1098] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:48.176610 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5b431-1e18-4bf5-91e5-6b6fb7da9d79 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:48.177193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5b431-1e18-4bf5-91e5-6b6fb7da9d79 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:48.177193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5b431-1e18-4bf5-91e5-6b6fb7da9d79 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:48.178579 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 553/1099] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:48.185020 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958578-8b60-421a-a1cd-319857c3e26e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:48.185464 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958578-8b60-421a-a1cd-319857c3e26e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:48.185567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958578-8b60-421a-a1cd-319857c3e26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:48.215192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-71958578-8b60-421a-a1cd-319857c3e26e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:48.216375 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-71958578-8b60-421a-a1cd-319857c3e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:48.225226 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 547/1100] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:48.565624 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5b431-1e18-4bf5-91e5-6b6fb7da9d79 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:48.581644 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5b431-1e18-4bf5-91e5-6b6fb7da9d79 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:48.587507 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6ab80-448b-4bd3-8b8a-c403da008369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:48.588424 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6ab80-448b-4bd3-8b8a-c403da008369 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:48.589165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6ab80-448b-4bd3-8b8a-c403da008369 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:48.589708 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6ab80-448b-4bd3-8b8a-c403da008369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:48.605080 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6ab80-448b-4bd3-8b8a-c403da008369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:48.606524 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6ab80-448b-4bd3-8b8a-c403da008369 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:48.616484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 554/1101] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:50.839376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386220-9c67-485f-a3de-5d55a3c666d9 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:50.840001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386220-9c67-485f-a3de-5d55a3c666d9 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:50.840001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f386220-9c67-485f-a3de-5d55a3c666d9 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:50.842134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 548/1102] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:50.850925 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82525c-9eac-4a53-b481-b767c54958eb None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:50.851377 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82525c-9eac-4a53-b481-b767c54958eb None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:50.851480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82525c-9eac-4a53-b481-b767c54958eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:50.873687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-5e82525c-9eac-4a53-b481-b767c54958eb None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:50.874876 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-5e82525c-9eac-4a53-b481-b767c54958eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:50.884048 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 555/1103] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:51.241852 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386220-9c67-485f-a3de-5d55a3c666d9 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:51.256817 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f386220-9c67-485f-a3de-5d55a3c666d9 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:51.262339 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75529351-aeb0-470c-9989-48218c553be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:51.263489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529351-aeb0-470c-9989-48218c553be8 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:51.263489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529351-aeb0-470c-9989-48218c553be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:51.263489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529351-aeb0-470c-9989-48218c553be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:51.275428 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75529351-aeb0-470c-9989-48218c553be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:51.277136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75529351-aeb0-470c-9989-48218c553be8 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:51.286903 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 549/1104] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:53.683159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daa910-dab7-41a1-ad06-55ca44d84af8 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:53.683159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daa910-dab7-41a1-ad06-55ca44d84af8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:53.684175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daa910-dab7-41a1-ad06-55ca44d84af8 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:53.685675 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 556/1105] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:53.692084 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428df15-fbf4-4b14-b14a-9f7ace9e11ca None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:53.692889 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428df15-fbf4-4b14-b14a-9f7ace9e11ca None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:53.693090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428df15-fbf4-4b14-b14a-9f7ace9e11ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:53.716700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-b428df15-fbf4-4b14-b14a-9f7ace9e11ca None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:53.717942 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-b428df15-fbf4-4b14-b14a-9f7ace9e11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:53.727934 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 550/1106] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:54.074336 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daa910-dab7-41a1-ad06-55ca44d84af8 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:54.091159 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daa910-dab7-41a1-ad06-55ca44d84af8 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:54.094738 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28d3c1-9bef-4362-81f9-e07940e1b7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:54.095335 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28d3c1-9bef-4362-81f9-e07940e1b7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:54.095608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28d3c1-9bef-4362-81f9-e07940e1b7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:54.095902 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28d3c1-9bef-4362-81f9-e07940e1b7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:54.105108 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28d3c1-9bef-4362-81f9-e07940e1b7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:54.106540 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28d3c1-9bef-4362-81f9-e07940e1b7a2 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:54.116089 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 557/1107] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:39:56.512720 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121d49-887e-4590-87e7-4b7b202cc282 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:56.513350 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121d49-887e-4590-87e7-4b7b202cc282 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:56.513350 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e121d49-887e-4590-87e7-4b7b202cc282 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:56.514884 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 551/1108] 10.222.0.26 () {54 vars in 927 bytes} [Sat Sep 3 20:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:39:56.521260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fead8-9ad5-481c-b1b2-3cddfc264549 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:56.522002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fead8-9ad5-481c-b1b2-3cddfc264549 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:56.522194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fead8-9ad5-481c-b1b2-3cddfc264549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:56.549188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-321fead8-9ad5-481c-b1b2-3cddfc264549 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:39:56.550372 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-321fead8-9ad5-481c-b1b2-3cddfc264549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:39:56.558881 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 558/1109] 10.222.0.26 () {58 vars in 1024 bytes} [Sat Sep 3 20:39:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:39:56.898618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121d49-887e-4590-87e7-4b7b202cc282 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:39:56.911340 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e121d49-887e-4590-87e7-4b7b202cc282 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:39:56.915110 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca7ae4-8b60-4614-85bf-8f33f1b7b992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:39:56.915728 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7ae4-8b60-4614-85bf-8f33f1b7b992 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:39:56.916008 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7ae4-8b60-4614-85bf-8f33f1b7b992 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:39:56.916265 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7ae4-8b60-4614-85bf-8f33f1b7b992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:39:56.927866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca7ae4-8b60-4614-85bf-8f33f1b7b992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:39:56.930177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca7ae4-8b60-4614-85bf-8f33f1b7b992 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:39:56.941560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 552/1110] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:39:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:40:06.544066 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=33 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:40:06.936588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=33 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:18.870503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:18.871534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:18.871534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:18.900675 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:41:18.902024 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:18.910706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 559/1111] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:41:18.918936 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:18.919479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:18.919479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:18.949467 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:41:18.951231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:18.962129 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 553/1112] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:41:18.968484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:18.979372 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f6d9d-4bbe-45ee-aae1-199e81f474ac None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:18.984460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:18.985096 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:18.985373 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:18.985639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:18.986608 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:41:18.986982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:18.988003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:18.988003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:41:18.988003 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:41:18.988891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.001174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 560/1113] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 3 20:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:41:19.009389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.019165 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689d86-7c20-44e6-823d-32c82315096e None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.025090 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.025688 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.025962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.026217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.026854 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.028661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:19.028661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:41:19.028661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:41:19.029912 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.062172 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 554/1114] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 3 20:41:19 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:41:19.068293 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.078628 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572b58f-fa58-4e8f-a00d-e27d311dcd93 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.144295 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.144986 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.145267 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.145539 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.146178 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.147204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:19.147204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:41:19.147204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:41:19.148422 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.170972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 561/1115] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:41:19 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:41:19.175485 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.186182 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed9b1c-ed3f-4005-864f-3386c042be7d admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.191550 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.192148 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.192420 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.192687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.193372 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.194414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:19.194414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:41:19.194414 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:41:19.195306 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.208338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 555/1116] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:41:19.212468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.222755 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdec4d-c70a-448e-8dbd-0e982cf90901 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.227558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.228155 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.228435 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.228701 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.229372 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.230385 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:19.230385 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:41:19.230385 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:41:19.231264 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235efc30-8745-465a-b424-2ae523dceec5 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.245213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 562/1117] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:41:19.249740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.261022 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c219a5-bc5e-460d-b8f0-aae36c231306 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.267030 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.267714 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.267985 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.268253 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] PATH_INFO: `/v3/projects/fbd89aac80934cd397e3547e1f5bcb46/users/11282c76dc2c4fa1a598aa267561f41e/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.284603 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd89aac80934cd397e3547e1f5bcb46, user_id=11282c76dc2c4fa1a598aa267561f41e, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.285679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:19.285679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:41:19.285679 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:41:19.287605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b967b8-7819-4aa3-a9d9-7da607adde03 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.305375 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 556/1118] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:41:19 2022] PUT /identity/v3/projects/fbd89aac80934cd397e3547e1f5bcb46/users/11282c76dc2c4fa1a598aa267561f41e/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:41:19.317813 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d80c-f603-4cd0-8e30-21486bf6af01 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.318088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d80c-f603-4cd0-8e30-21486bf6af01 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.318382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135d80c-f603-4cd0-8e30-21486bf6af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.348942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-f135d80c-f603-4cd0-8e30-21486bf6af01 None None] MFA Rules not processed for user `11282c76dc2c4fa1a598aa267561f41e`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:41:19.350828 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-f135d80c-f603-4cd0-8e30-21486bf6af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:19.431454 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 563/1119] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:41:19.445490 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384f5c-4522-4aac-a4f7-e556ef445b68 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.445782 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384f5c-4522-4aac-a4f7-e556ef445b68 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.446050 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384f5c-4522-4aac-a4f7-e556ef445b68 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.447404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 557/1120] 10.222.0.26 () {54 vars in 964 bytes} [Sat Sep 3 20:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:41:19.452333 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc276ba-a461-4647-9281-1a8644b8456d None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.452611 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc276ba-a461-4647-9281-1a8644b8456d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.452898 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc276ba-a461-4647-9281-1a8644b8456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.473107 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-8bc276ba-a461-4647-9281-1a8644b8456d None None] MFA Rules not processed for user `c1da13ce94a741168b0e6d09bf9342e4`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:41:19.474295 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-8bc276ba-a461-4647-9281-1a8644b8456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:19.526731 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:19.536936 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 564/1121] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Sep 3 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:41:19.544918 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384f5c-4522-4aac-a4f7-e556ef445b68 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.557938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384f5c-4522-4aac-a4f7-e556ef445b68 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.561879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1da13ce94a741168b0e6d09bf9342e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.562443 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.562714 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.562979 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.571815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.573342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.582127 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 558/1122] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:41:19 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:41:19.623930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88643f-8f2c-4c7d-871e-bcd9040abe32 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.624278 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88643f-8f2c-4c7d-871e-bcd9040abe32 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.624648 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88643f-8f2c-4c7d-871e-bcd9040abe32 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.626431 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 565/1123] 10.222.0.26 () {52 vars in 830 bytes} [Sat Sep 3 20:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:41:19.631316 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.700053 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ebff-6008-431d-a8e5-a1d4d209a21e service cinder] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:19.705425 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:19.706046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.706318 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.706585 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] PATH_INFO: `/v3/users/11282c76dc2c4fa1a598aa267561f41e` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.707728 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11282c76dc2c4fa1a598aa267561f41e)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:19.709138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:19.709138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:41:19.709138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:41:19.710342 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:19.786199 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11282c76dc2c4fa1a598aa267561f41e'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:19.786904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11282c76dc2c4fa1a598aa267561f41e'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:19.802715 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11282c76dc2c4fa1a598aa267561f41e'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:19.816123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11282c76dc2c4fa1a598aa267561f41e'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:19.816948 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11282c76dc2c4fa1a598aa267561f41e'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:19.847540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 559/1124] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 3 20:41:19 2022] DELETE /identity/v3/users/11282c76dc2c4fa1a598aa267561f41e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:41:19.852154 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:19.852508 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:19.852781 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:19.872671 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:41:19.873900 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:19.936397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 566/1125] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:41:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:41:19.946999 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:19.948472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:19.954136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:20.011423 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00265-0591-4847-bf77-65c8a8b33b21 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:20.016227 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d23e63-1fd9-4d10-8336-da1c14b3fe1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:20.016848 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23e63-1fd9-4d10-8336-da1c14b3fe1a service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:20.017124 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23e63-1fd9-4d10-8336-da1c14b3fe1a service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:20.017885 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d23e63-1fd9-4d10-8336-da1c14b3fe1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:20.028567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d23e63-1fd9-4d10-8336-da1c14b3fe1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:20.030073 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d23e63-1fd9-4d10-8336-da1c14b3fe1a service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:20.039870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 560/1126] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:41:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:41:20.395235 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:41:20.396999 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:41:20.409420 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8586d5-6c8f-4a43-9e80-bc1ee4eb5435 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:41:20.414982 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:41:20.415623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] REQUEST_METHOD: `DELETE` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:41:20.415900 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:41:20.416167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] PATH_INFO: `/v3/projects/fbd89aac80934cd397e3547e1f5bcb46` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:41:20.417534 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd89aac80934cd397e3547e1f5bcb46)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:41:20.418568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:41:20.418568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:41:20.418568 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:41:20.419776 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:41:20.489481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd89aac80934cd397e3547e1f5bcb46', 'request_id': 'req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:20.503370 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd89aac80934cd397e3547e1f5bcb46', 'request_id': 'req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:20.516521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd89aac80934cd397e3547e1f5bcb46', 'request_id': 'req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:20.536236 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] The token cache is being invalidate because project fbd89aac80934cd397e3547e1f5bcb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94931) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 20:41:20.536637 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:20.537833 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-dabf0dd5-cf6d-4e0e-b8ed-a0e686d3784b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:41:20.540293 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 567/1127] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 3 20:41:20 2022] DELETE /identity/v3/projects/fbd89aac80934cd397e3547e1f5bcb46 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:41:30.035545 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=25 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:41:30.530558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:42:44.507955 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd3df-6ea7-42cd-ad61-d45815dd10ec None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:44.508676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd3df-6ea7-42cd-ad61-d45815dd10ec None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:44.508676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd3df-6ea7-42cd-ad61-d45815dd10ec None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:44.510066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 561/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:42:44.516147 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3035e1-5ef0-44b7-b465-a621845b1605 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:44.516612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3035e1-5ef0-44b7-b465-a621845b1605 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:44.516717 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3035e1-5ef0-44b7-b465-a621845b1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:44.603193 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-bc3035e1-5ef0-44b7-b465-a621845b1605 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:42:44.604401 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-bc3035e1-5ef0-44b7-b465-a621845b1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:44.715871 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 568/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:42:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:42:44.878628 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fd3df-6ea7-42cd-ad61-d45815dd10ec None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:42:44.880969 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-649fd3df-6ea7-42cd-ad61-d45815dd10ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:44.974019 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fd3df-6ea7-42cd-ad61-d45815dd10ec None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:42:44.979946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea850c1-bdf7-45fc-ab71-c5f96618f24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:42:44.980541 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea850c1-bdf7-45fc-ab71-c5f96618f24c service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:44.980811 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea850c1-bdf7-45fc-ab71-c5f96618f24c service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:44.981105 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea850c1-bdf7-45fc-ab71-c5f96618f24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:44.990222 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea850c1-bdf7-45fc-ab71-c5f96618f24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:42:44.991788 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea850c1-bdf7-45fc-ab71-c5f96618f24c service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:42:45.001271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 562/1130] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:42:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:42:45.825758 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae85a63-5823-4fd5-825f-dd20909dbe3d None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:45.826345 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae85a63-5823-4fd5-825f-dd20909dbe3d None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:45.826455 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae85a63-5823-4fd5-825f-dd20909dbe3d None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:45.828583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 569/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:42:45.836637 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a7165-4967-407d-950e-8d45736da687 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:45.837065 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a7165-4967-407d-950e-8d45736da687 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:45.837212 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a7165-4967-407d-950e-8d45736da687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:45.860441 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-429a7165-4967-407d-950e-8d45736da687 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:42:45.861665 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-429a7165-4967-407d-950e-8d45736da687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:45.870548 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 563/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:42:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:42:46.028161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae85a63-5823-4fd5-825f-dd20909dbe3d None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:42:46.047811 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae85a63-5823-4fd5-825f-dd20909dbe3d None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:42:46.054038 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f906e-25b3-4789-aa75-9aa82b21a4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:42:46.054634 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f906e-25b3-4789-aa75-9aa82b21a4b9 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:46.054943 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f906e-25b3-4789-aa75-9aa82b21a4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:46.055213 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f906e-25b3-4789-aa75-9aa82b21a4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:46.068907 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f906e-25b3-4789-aa75-9aa82b21a4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:42:46.071121 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f906e-25b3-4789-aa75-9aa82b21a4b9 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:42:46.081257 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 570/1133] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:42:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:42:50.588117 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc95f5-06b8-4f6a-a23f-9dd2f6cee6b6 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:50.589072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc95f5-06b8-4f6a-a23f-9dd2f6cee6b6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:50.589072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc95f5-06b8-4f6a-a23f-9dd2f6cee6b6 None None] PATH_INFO: `/v3` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:50.591093 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 564/1134] 10.222.0.18 () {54 vars in 925 bytes} [Sat Sep 3 20:42:50 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:42:50.602601 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ba46-d193-46e1-8048-667fc80a9425 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:50.603068 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ba46-d193-46e1-8048-667fc80a9425 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:50.603188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ba46-d193-46e1-8048-667fc80a9425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:50.634866 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-3ff0ba46-d193-46e1-8048-667fc80a9425 None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:42:50.636067 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-3ff0ba46-d193-46e1-8048-667fc80a9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:50.697701 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:42:50.708313 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 571/1135] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Sep 3 20:42:50 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:42:55.230381 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2816-a64b-44d7-a8cf-a76e9ff38146 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:55.231036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2816-a64b-44d7-a8cf-a76e9ff38146 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:55.231036 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2816-a64b-44d7-a8cf-a76e9ff38146 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:55.232249 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 565/1136] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 3 20:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:42:55.238621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fc07-8d05-46c8-b1fc-32f966f400ad None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:55.239361 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fc07-8d05-46c8-b1fc-32f966f400ad None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:55.239475 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6fc07-8d05-46c8-b1fc-32f966f400ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:55.266711 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-58c6fc07-8d05-46c8-b1fc-32f966f400ad None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:42:55.267927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-58c6fc07-8d05-46c8-b1fc-32f966f400ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:55.277408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 572/1137] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 3 20:42:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:42:55.285290 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2816-a64b-44d7-a8cf-a76e9ff38146 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:42:55.300946 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2816-a64b-44d7-a8cf-a76e9ff38146 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:42:55.306497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710433f4-f103-4d74-b17b-d882c6a8cd57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:42:55.307089 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710433f4-f103-4d74-b17b-d882c6a8cd57 service placement] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:55.307364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710433f4-f103-4d74-b17b-d882c6a8cd57 service placement] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:55.307630 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710433f4-f103-4d74-b17b-d882c6a8cd57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:55.316681 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710433f4-f103-4d74-b17b-d882c6a8cd57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:42:55.318521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710433f4-f103-4d74-b17b-d882c6a8cd57 service placement] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:42:55.328801 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 566/1138] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:42:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:42:57.345058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618be0-2e58-4307-8ee3-158e8ea0e391 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:57.345544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618be0-2e58-4307-8ee3-158e8ea0e391 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:57.345657 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618be0-2e58-4307-8ee3-158e8ea0e391 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:57.347137 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:42:57.352011 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f913b-467e-4c3c-a616-3f2a45ba3608 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:57.352457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f913b-467e-4c3c-a616-3f2a45ba3608 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:57.352552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f913b-467e-4c3c-a616-3f2a45ba3608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:57.371920 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-be3f913b-467e-4c3c-a616-3f2a45ba3608 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:42:57.373139 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-be3f913b-467e-4c3c-a616-3f2a45ba3608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:57.381198 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:42:57.542704 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618be0-2e58-4307-8ee3-158e8ea0e391 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:42:57.563161 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618be0-2e58-4307-8ee3-158e8ea0e391 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:42:57.571002 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac360-191e-45ad-a302-b69374a18fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:42:57.571824 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac360-191e-45ad-a302-b69374a18fde service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:57.572186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac360-191e-45ad-a302-b69374a18fde service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:57.572539 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac360-191e-45ad-a302-b69374a18fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:57.581299 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac360-191e-45ad-a302-b69374a18fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:42:57.582875 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ac360-191e-45ad-a302-b69374a18fde service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:42:57.592646 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 574/1141] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:42:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:42:58.412806 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77a48-5524-4df1-8e8e-1ff7240e771b None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:58.413399 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77a48-5524-4df1-8e8e-1ff7240e771b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:58.413399 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77a48-5524-4df1-8e8e-1ff7240e771b None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:58.414639 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:42:58.420972 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959fb04-3b66-4e47-92d6-5f045c252423 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:58.421702 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959fb04-3b66-4e47-92d6-5f045c252423 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:58.421852 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959fb04-3b66-4e47-92d6-5f045c252423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:58.447141 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-d959fb04-3b66-4e47-92d6-5f045c252423 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:42:58.448433 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-d959fb04-3b66-4e47-92d6-5f045c252423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:42:58.458932 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:42:58.631964 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77a48-5524-4df1-8e8e-1ff7240e771b None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:42:58.654489 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77a48-5524-4df1-8e8e-1ff7240e771b None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:42:58.660307 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018c12c-1185-4166-9815-96dfc0d1fd97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:42:58.660931 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c12c-1185-4166-9815-96dfc0d1fd97 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:42:58.661203 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c12c-1185-4166-9815-96dfc0d1fd97 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:42:58.661468 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c12c-1185-4166-9815-96dfc0d1fd97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:42:58.670587 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018c12c-1185-4166-9815-96dfc0d1fd97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:42:58.672107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018c12c-1185-4166-9815-96dfc0d1fd97 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:42:58.682160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 569/1144] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:42:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:43:02.829984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd8f8b-193f-49d5-b09e-6a342523a424 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:02.831054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd8f8b-193f-49d5-b09e-6a342523a424 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:02.831054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd8f8b-193f-49d5-b09e-6a342523a424 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:02.833049 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:43:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:43:02.840588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26e8f-387d-419b-aff8-68b4a8bb7df4 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:02.841085 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26e8f-387d-419b-aff8-68b4a8bb7df4 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:02.841204 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af26e8f-387d-419b-aff8-68b4a8bb7df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:02.861255 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9af26e8f-387d-419b-aff8-68b4a8bb7df4 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:43:02.862461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9af26e8f-387d-419b-aff8-68b4a8bb7df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:02.871119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:43:03.211693 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd8f8b-193f-49d5-b09e-6a342523a424 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:43:03.215419 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-3bfd8f8b-193f-49d5-b09e-6a342523a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:03.285421 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd8f8b-193f-49d5-b09e-6a342523a424 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:43:03.289951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6b5d9-4f52-4f84-aa72-4e37c9072670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:43:03.290560 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6b5d9-4f52-4f84-aa72-4e37c9072670 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:03.290833 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6b5d9-4f52-4f84-aa72-4e37c9072670 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:03.291131 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6b5d9-4f52-4f84-aa72-4e37c9072670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:03.300264 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6b5d9-4f52-4f84-aa72-4e37c9072670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:43:03.301750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6b5d9-4f52-4f84-aa72-4e37c9072670 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:43:03.311076 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 577/1147] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:43:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:43:05.469792 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316720-1716-4c01-ac68-e110a0e24e7d None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:05.470677 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316720-1716-4c01-ac68-e110a0e24e7d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:05.470677 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2316720-1716-4c01-ac68-e110a0e24e7d None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:05.472622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 571/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:43:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:43:05.478870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481a081-564c-4424-bd15-884c544031bd None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:05.479341 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481a081-564c-4424-bd15-884c544031bd None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:05.479552 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481a081-564c-4424-bd15-884c544031bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:05.501912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-1481a081-564c-4424-bd15-884c544031bd None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:43:05.503116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-1481a081-564c-4424-bd15-884c544031bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:05.513005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 578/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:43:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:43:05.850240 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2316720-1716-4c01-ac68-e110a0e24e7d None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:43:05.852410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-e2316720-1716-4c01-ac68-e110a0e24e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:05.866656 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2316720-1716-4c01-ac68-e110a0e24e7d None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:43:05.871507 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916051e-fd28-4428-bcd9-5e32483a1379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:43:05.872115 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916051e-fd28-4428-bcd9-5e32483a1379 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:05.872386 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916051e-fd28-4428-bcd9-5e32483a1379 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:05.872663 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916051e-fd28-4428-bcd9-5e32483a1379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:05.882811 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916051e-fd28-4428-bcd9-5e32483a1379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:43:05.884269 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916051e-fd28-4428-bcd9-5e32483a1379 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:43:05.894621 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 572/1150] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:43:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:43:09.748273 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4508-160a-4a1f-86b3-da64e431b6a7 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:09.749223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4508-160a-4a1f-86b3-da64e431b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:09.749223 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd4508-160a-4a1f-86b3-da64e431b6a7 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:09.751487 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 579/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:43:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:43:09.757780 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df55be-1272-49ae-b70d-4d1e53d57360 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:09.758252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df55be-1272-49ae-b70d-4d1e53d57360 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:09.758356 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df55be-1272-49ae-b70d-4d1e53d57360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:09.785556 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-38df55be-1272-49ae-b70d-4d1e53d57360 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:43:09.786756 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-38df55be-1272-49ae-b70d-4d1e53d57360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:09.796088 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 573/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:43:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:43:10.380181 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd4508-160a-4a1f-86b3-da64e431b6a7 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:43:10.382204 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-3dcd4508-160a-4a1f-86b3-da64e431b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:10.443844 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd4508-160a-4a1f-86b3-da64e431b6a7 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:43:10.448216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80033d9b-9910-46f0-a0a8-f5a77be5baf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1da13ce94a741168b0e6d09bf9342e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:43:10.448874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80033d9b-9910-46f0-a0a8-f5a77be5baf2 service cinder] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:10.449174 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80033d9b-9910-46f0-a0a8-f5a77be5baf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:10.449440 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80033d9b-9910-46f0-a0a8-f5a77be5baf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:10.458799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80033d9b-9910-46f0-a0a8-f5a77be5baf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:43:10.460254 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80033d9b-9910-46f0-a0a8-f5a77be5baf2 service cinder] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:43:10.469976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 580/1153] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:43:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:43:12.694101 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3babdc-2d1d-4e98-9a3a-bc3263fac7a8 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:12.694983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3babdc-2d1d-4e98-9a3a-bc3263fac7a8 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:12.694983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3babdc-2d1d-4e98-9a3a-bc3263fac7a8 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:12.697076 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 574/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 20:43:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:43:12.704923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114930e-f8c6-4cef-8586-c88293644c98 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:12.705383 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114930e-f8c6-4cef-8586-c88293644c98 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:12.705492 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114930e-f8c6-4cef-8586-c88293644c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:12.726870 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b114930e-f8c6-4cef-8586-c88293644c98 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:43:12.728165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b114930e-f8c6-4cef-8586-c88293644c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:12.739013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 581/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 20:43:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 20:43:13.302073 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3babdc-2d1d-4e98-9a3a-bc3263fac7a8 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:43:13.304000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-1e3babdc-2d1d-4e98-9a3a-bc3263fac7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:43:13.312327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=70 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:43:13.318841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3babdc-2d1d-4e98-9a3a-bc3263fac7a8 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:43:13.322700 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45356f-bc63-4c45-87de-39441986a171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1da13ce94a741168b0e6d09bf9342e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:43:13.323282 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45356f-bc63-4c45-87de-39441986a171 service cinder] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:43:13.323552 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45356f-bc63-4c45-87de-39441986a171 service cinder] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:43:13.323816 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45356f-bc63-4c45-87de-39441986a171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:43:13.333004 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45356f-bc63-4c45-87de-39441986a171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:43:13.334417 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45356f-bc63-4c45-87de-39441986a171 service cinder] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:43:13.343856 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 575/1156] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:43:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:43:22.721073 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=70 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:43:23.339907 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=5 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:27.283771 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.284467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.284467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.304447 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:27.305668 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:27.314194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 582/1157] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:27.322214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19b07-2f41-406b-af32-c2861581e81b None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.322764 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19b07-2f41-406b-af32-c2861581e81b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.322764 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe19b07-2f41-406b-af32-c2861581e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.342687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-1fe19b07-2f41-406b-af32-c2861581e81b None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:27.343894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-1fe19b07-2f41-406b-af32-c2861581e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:27.352044 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 576/1158] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:27.356858 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.365123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185ed1-a239-4a73-b249-75c78a376080 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.365408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185ed1-a239-4a73-b249-75c78a376080 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.365676 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae185ed1-a239-4a73-b249-75c78a376080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.367791 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001e65-8219-4860-9541-3da9a71766aa None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.372486 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.373104 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.373493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.373665 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] PATH_INFO: `/v3/domains` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.374316 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:44:27.374621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.376320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.385466 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-ae185ed1-a239-4a73-b249-75c78a376080 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:27.386625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-ae185ed1-a239-4a73-b249-75c78a376080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:27.388714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 583/1159] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 20:44:27.395523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 577/1160] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:27.398619 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.403387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.403654 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.403920 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.408859 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb82be-78eb-4502-a029-e51af630c49f admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.413362 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.413949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.414220 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.414484 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.415113 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.416121 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:44:27.416121 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:44:27.416121 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:44:27.417340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.423427 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:27.424609 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:27.432412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 578/1161] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:27.436961 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.445873 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e595b-4e8c-4350-aaf8-ad682c2c6443 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.450622 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.451154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.451460 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.451806 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.452594 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94930) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 20:44:27.452927 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.453932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:44:27.453932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:44:27.453932 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:44:27.454810 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.455987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 584/1162] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:44:27.459792 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.469349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 579/1163] 10.222.0.26 () {58 vars in 1153 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 20:44:27.477214 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.486753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb31b38-b010-4368-a21f-050308b1cad0 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.521325 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee13b50-3736-4de4-b137-2f6a42cc5942 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.526058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.526692 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.526942 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.527234 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] PATH_INFO: `/v3/users` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.527838 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.529912 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.552376 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.553031 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.556241 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 585/1164] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:44:27.556364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.556364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] PATH_INFO: `/v3/projects` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.556364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.556687 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.557623 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.568095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4067014-b923-4fcd-815b-bc94691b04d8 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.573050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.574117 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.574713 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.575019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.575845 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.578034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.586006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 580/1165] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:44:27.590232 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.591583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 586/1166] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:44:27.595442 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.605077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b41a25-ff3c-4d9a-aa01-ef3a982bf60c admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.653277 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463290b-2960-45fb-840e-f2ad2be78883 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.658879 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.659493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.659771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.660042 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.660725 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.661773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:44:27.661773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:44:27.661773 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:44:27.662938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.663355 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.663965 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.664243 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.664529 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.665199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.666799 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.677013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 587/1167] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:44:27.681232 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.692345 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc63c49-e9fc-4ec5-9c74-2ea3f966ce3a admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.697095 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 581/1168] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:44:27.697397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.698047 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.698319 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.698421 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.698585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] PATH_INFO: `/v3/projects/dab54805412b4127823b601e3d8092b7/users/b00e4c42dc654f13864faf49f9927c54/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.708774 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d2cc9-0276-4a2e-b1f3-f423d8f2b355 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.713512 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.713713 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab54805412b4127823b601e3d8092b7, user_id=b00e4c42dc654f13864faf49f9927c54, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.714154 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.714453 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.714702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.714976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:44:27.714976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:44:27.714976 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:44:27.715358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.717245 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae3ed8-dd3b-4270-95bf-370b2df0ac20 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.718046 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.729408 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:27.729719 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 582/1169] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:44:27.734001 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.737974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 588/1170] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:44:27 2022] PUT /identity/v3/projects/dab54805412b4127823b601e3d8092b7/users/b00e4c42dc654f13864faf49f9927c54/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:44:27.742736 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.743018 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.743312 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.744259 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3316f3ac-700f-4084-bb73-f12f75800baa admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.761853 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:27.763061 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:27.773225 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:27.802670 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.803285 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.803566 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.803833 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] PATH_INFO: `/v3/roles` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.804472 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.806099 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.816156 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 583/1171] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 20:44:27.820327 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.825606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 589/1172] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:27.833231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0f76f-d720-4417-94de-55afd6ceedce admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.835709 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.838098 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1ac9-4dde-47fe-9637-749a382109f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.838750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1ac9-4dde-47fe-9637-749a382109f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.839028 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1ac9-4dde-47fe-9637-749a382109f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.839287 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1ac9-4dde-47fe-9637-749a382109f0 admin admin] PATH_INFO: `/v3/projects/6dafddda9c34412dad0d72ac51f50426/users/7f45705abc4449acae31dd145676d0fe/roles/cc1e3f9326fe428799f18f2167cad262` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.853965 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1ac9-4dde-47fe-9637-749a382109f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dafddda9c34412dad0d72ac51f50426, user_id=7f45705abc4449acae31dd145676d0fe, role_id=cc1e3f9326fe428799f18f2167cad262)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.856654 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d1ac9-4dde-47fe-9637-749a382109f0 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:27.872449 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 584/1173] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:44:27 2022] PUT /identity/v3/projects/6dafddda9c34412dad0d72ac51f50426/users/7f45705abc4449acae31dd145676d0fe/roles/cc1e3f9326fe428799f18f2167cad262 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:44:27.877933 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.878217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.878487 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.890908 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9837309-154f-42cf-9c27-b2a03aeff36a None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.897722 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] MFA Rules not processed for user `34c7ada225bf4c9f83deb9a393935185`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:27.898931 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:27.939951 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.940481 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.940749 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.941046 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.962272 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 585/1174] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 20:44:27.969866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:27.978994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24b69c-e6f1-4db7-a336-a7a0bc4b3f7e None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:27.982625 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a0ca5-7db1-453f-86cd-cc738b982f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:27.983281 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0ca5-7db1-453f-86cd-cc738b982f8c service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:27.983555 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0ca5-7db1-453f-86cd-cc738b982f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:27.983894 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0ca5-7db1-453f-86cd-cc738b982f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:27.993321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a0ca5-7db1-453f-86cd-cc738b982f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:27.994759 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a0ca5-7db1-453f-86cd-cc738b982f8c service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:28.003954 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 586/1175] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:44:28.004240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:28.005790 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:28.015761 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 590/1176] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:44:33.030786 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.032407 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.032896 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.086303 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] MFA Rules not processed for user `b00e4c42dc654f13864faf49f9927c54`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:33.088449 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:33.270545 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 587/1177] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:33 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:33.279276 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.302277 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19302c8-9131-490f-968d-2d4f7d6be28d service neutron] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.314299 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.315199 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.315480 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.315750 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.316410 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.325225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:33.336726 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:33.381123 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 591/1178] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 3 20:44:33 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:44:33.384823 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.405357 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b657c-7a67-4f4e-ba24-81168619e7d7 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.449286 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:33.531709 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.532252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.532529 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.532798 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.533469 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.535439 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:33.574052 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 588/1179] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:44:33 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:44:33.575022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.591593 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2e61-6a6d-48ac-b478-7371991c7182 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.602014 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.602786 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.602921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.603180 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.603905 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.605715 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:33.633263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 592/1180] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 20:44:33.635174 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.650145 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474f85-b268-499e-9297-753d5fae42b8 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.660891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d226-8d65-4eb4-8ada-085835693d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.660891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d226-8d65-4eb4-8ada-085835693d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.660891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d226-8d65-4eb4-8ada-085835693d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.661495 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d226-8d65-4eb4-8ada-085835693d7e admin admin] PATH_INFO: `/v3/projects/7f91c36fabea4c929d3aaa55c1951039/users/27fc4ee4837b4cbdb496d1520ff44dc4/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.681158 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11d226-8d65-4eb4-8ada-085835693d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f91c36fabea4c929d3aaa55c1951039, user_id=27fc4ee4837b4cbdb496d1520ff44dc4, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.684016 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11d226-8d65-4eb4-8ada-085835693d7e admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:33.703234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 589/1181] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:44:33 2022] PUT /identity/v3/projects/7f91c36fabea4c929d3aaa55c1951039/users/27fc4ee4837b4cbdb496d1520ff44dc4/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:44:33.707849 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.720717 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069c5c1-b14d-4cf8-b61d-93de8d341402 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.769984 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.770349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.770601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.799687 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.800630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.801128 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.801404 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:33.801797 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.802627 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:33.802853 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.804639 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:33.818588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 593/1182] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:44:33.819621 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.831882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea55d9c-a169-4761-bfaf-3413b86f5c37 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.837050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.837604 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.837874 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.838149 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] PATH_INFO: `/v3/projects/7f91c36fabea4c929d3aaa55c1951039/users/27fc4ee4837b4cbdb496d1520ff44dc4/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.840194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f91c36fabea4c929d3aaa55c1951039, user_id=27fc4ee4837b4cbdb496d1520ff44dc4, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.844140 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:33.859658 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 594/1183] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:44:33 2022] PUT /identity/v3/projects/7f91c36fabea4c929d3aaa55c1951039/users/27fc4ee4837b4cbdb496d1520ff44dc4/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 20:44:33.892497 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 590/1184] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:33 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 20:44:33.897467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:33.975743 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19459c-7273-49da-8949-f4319a200bd5 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:33.983179 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:33.984585 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:33.984754 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:33.988589 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] PATH_INFO: `/v3/projects` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:33.989418 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:33.992548 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:34.061890 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:34.064622 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 595/1185] 10.222.0.26 () {60 vars in 1153 bytes} [Sat Sep 3 20:44:33 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 20:44:34.077853 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dd3fa-9624-44cd-9865-c7d357b0c164 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:34.177165 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:34.178365 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:34.178866 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:34.179457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] PATH_INFO: `/v3/users` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:34.180390 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:34.182925 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:34.213433 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 591/1186] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Sep 3 20:44:34 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 20:44:34.218005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:34.235569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4adf44-8219-4fd2-a052-4cd8aea7444e admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:34.250964 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:34.251994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:34.252496 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:34.253019 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:34.253985 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:34.256022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:34.329312 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 596/1187] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:44:34.330960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:34.338877 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:34.354631 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970c223-3064-4a5c-b3d3-aeee2bd730e1 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:34.376602 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:34.377549 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:34.377996 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:34.378410 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] PATH_INFO: `/v3/projects/d126f6e47c3742618d55b716f2778a0f/users/0eaeec6dec2f4c36b2d959859b87badd/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:34.398840 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d126f6e47c3742618d55b716f2778a0f, user_id=0eaeec6dec2f4c36b2d959859b87badd, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:34.402183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:34.425216 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 592/1188] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:44:34 2022] PUT /identity/v3/projects/d126f6e47c3742618d55b716f2778a0f/users/0eaeec6dec2f4c36b2d959859b87badd/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:44:34.429033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:34.439914 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095f41b-8449-456e-bb3e-c02c2b653651 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:34.483225 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:34.538670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefab04-6315-4a36-b32c-5df94d9f11ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:34.540069 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefab04-6315-4a36-b32c-5df94d9f11ae admin admin] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:34.540922 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefab04-6315-4a36-b32c-5df94d9f11ae admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:34.541266 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefab04-6315-4a36-b32c-5df94d9f11ae admin admin] PATH_INFO: `/v3/roles` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:34.542007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefab04-6315-4a36-b32c-5df94d9f11ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:34.544393 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefab04-6315-4a36-b32c-5df94d9f11ae admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:34.565620 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 597/1189] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 3 20:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 20:44:34.570162 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:34.588029 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dae46-0aa3-4124-b88e-d9c3ef2c1f85 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:34.595123 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:34.596110 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:34.596542 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:34.597215 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] PATH_INFO: `/v3/projects/d126f6e47c3742618d55b716f2778a0f/users/0eaeec6dec2f4c36b2d959859b87badd/roles/a8de70c7e0064d04a6fe974cc4a42ca8` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:34.602149 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d126f6e47c3742618d55b716f2778a0f, user_id=0eaeec6dec2f4c36b2d959859b87badd, role_id=a8de70c7e0064d04a6fe974cc4a42ca8)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:34.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:34.634669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 593/1190] 10.222.0.26 () {60 vars in 1483 bytes} [Sat Sep 3 20:44:34 2022] PUT /identity/v3/projects/d126f6e47c3742618d55b716f2778a0f/users/0eaeec6dec2f4c36b2d959859b87badd/roles/a8de70c7e0064d04a6fe974cc4a42ca8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:44:39.645775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d663a6-f6d2-4204-8a39-3cb5510db63b None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:39.646248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d663a6-f6d2-4204-8a39-3cb5510db63b None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:39.646347 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d663a6-f6d2-4204-8a39-3cb5510db63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:39.688562 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-d3d663a6-f6d2-4204-8a39-3cb5510db63b None None] MFA Rules not processed for user `27fc4ee4837b4cbdb496d1520ff44dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:39.690461 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-d3d663a6-f6d2-4204-8a39-3cb5510db63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:39.862010 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 598/1191] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:39 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:39.882406 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:39.884944 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:40.037419 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277ce8-d8d5-4434-ae52-1e7dc8d04e7b admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:40.041559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5edd41adff4d35b34dfa7bad99e4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:40.042234 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:40.042512 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:40.042782 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:40.176759 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:40.184734 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:40.198559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 594/1192] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:39 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:44:40.662060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6e5c-f3a9-47e3-b963-50b4f6c7dba2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:40.663041 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6e5c-f3a9-47e3-b963-50b4f6c7dba2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:40.663503 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6e5c-f3a9-47e3-b963-50b4f6c7dba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:40.712930 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-231e6e5c-f3a9-47e3-b963-50b4f6c7dba2 None None] MFA Rules not processed for user `0eaeec6dec2f4c36b2d959859b87badd`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:40.721500 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-231e6e5c-f3a9-47e3-b963-50b4f6c7dba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:40.860280 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 599/1193] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:40 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:40.875070 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:40.883177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3963ffc-5bbd-475a-b551-f168e686ca5d service glance] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:40.887950 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa0fe6-3d0d-4ec4-a2df-4bf1df33d676 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5edd41adff4d35b34dfa7bad99e4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:40.888570 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0fe6-3d0d-4ec4-a2df-4bf1df33d676 service glance] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:40.888959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0fe6-3d0d-4ec4-a2df-4bf1df33d676 service glance] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:40.889321 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0fe6-3d0d-4ec4-a2df-4bf1df33d676 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:40.966717 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa0fe6-3d0d-4ec4-a2df-4bf1df33d676 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:40.968448 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa0fe6-3d0d-4ec4-a2df-4bf1df33d676 service glance] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:40.980520 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 595/1194] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:40 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:44:48.509862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44957-72ba-4cbe-b2f7-cb588121fc2a None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:48.510444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44957-72ba-4cbe-b2f7-cb588121fc2a None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:48.510444 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf44957-72ba-4cbe-b2f7-cb588121fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:48.530060 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-3cf44957-72ba-4cbe-b2f7-cb588121fc2a None None] MFA Rules not processed for user `b00e4c42dc654f13864faf49f9927c54`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:48.531250 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-3cf44957-72ba-4cbe-b2f7-cb588121fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:48.538119 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 600/1195] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:44:48 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:48.831076 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03e3a-3331-4eae-9887-35a6a48eaeb2 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:48.831867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03e3a-3331-4eae-9887-35a6a48eaeb2 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:48.831867 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03e3a-3331-4eae-9887-35a6a48eaeb2 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:48.833449 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 596/1196] 10.222.0.26 () {54 vars in 962 bytes} [Sat Sep 3 20:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:44:48.842302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f410311-b4ab-48e6-9229-0def948f9dc2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:48.842302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f410311-b4ab-48e6-9229-0def948f9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:48.842302 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f410311-b4ab-48e6-9229-0def948f9dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:48.877460 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-2f410311-b4ab-48e6-9229-0def948f9dc2 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:48.878646 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-2f410311-b4ab-48e6-9229-0def948f9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:48.891544 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=100 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:48.944058 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 601/1197] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Sep 3 20:44:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:48.949730 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224808-aa4a-4f63-acb9-7894889cef40 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:48.950086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224808-aa4a-4f63-acb9-7894889cef40 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:48.950442 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224808-aa4a-4f63-acb9-7894889cef40 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:48.952253 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 597/1198] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 3 20:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:44:48.957815 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc0b13-4e4f-437d-9f03-21d1f47005d2 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:48.958116 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc0b13-4e4f-437d-9f03-21d1f47005d2 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:48.958371 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc0b13-4e4f-437d-9f03-21d1f47005d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:48.978888 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-8afc0b13-4e4f-437d-9f03-21d1f47005d2 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:48.980090 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-8afc0b13-4e4f-437d-9f03-21d1f47005d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:48.989340 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 602/1199] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 3 20:44:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:49.001033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22224808-aa4a-4f63-acb9-7894889cef40 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:49.002733 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-22224808-aa4a-4f63-acb9-7894889cef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:49.016492 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22224808-aa4a-4f63-acb9-7894889cef40 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:49.020425 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7393d53-6c09-4147-a962-2caf586fc2b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5edd41adff4d35b34dfa7bad99e4a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:49.021122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393d53-6c09-4147-a962-2caf586fc2b6 service glance] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:49.021465 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393d53-6c09-4147-a962-2caf586fc2b6 service glance] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:49.021798 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7393d53-6c09-4147-a962-2caf586fc2b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:49.030850 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:44:49.035632 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7393d53-6c09-4147-a962-2caf586fc2b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:49.037523 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7393d53-6c09-4147-a962-2caf586fc2b6 service glance] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:49.049847 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 598/1200] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:44:49.400194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072bec-12a4-4ca1-a13a-e02bbb7462a1 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:49.400583 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072bec-12a4-4ca1-a13a-e02bbb7462a1 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:49.402382 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3072bec-12a4-4ca1-a13a-e02bbb7462a1 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:49.402523 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 603/1201] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 3 20:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:44:49.408763 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfbcd-e331-45b3-bfdf-b421529a5684 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:49.409134 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfbcd-e331-45b3-bfdf-b421529a5684 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:49.409353 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcfbcd-e331-45b3-bfdf-b421529a5684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:49.454298 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-c3fcfbcd-e331-45b3-bfdf-b421529a5684 None None] MFA Rules not processed for user `0a022837bc064674a9b648976e37f9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:49.455883 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-c3fcfbcd-e331-45b3-bfdf-b421529a5684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:49.513547 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 599/1202] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 3 20:44:49 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:49.525287 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072bec-12a4-4ca1-a13a-e02bbb7462a1 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:49.536929 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3072bec-12a4-4ca1-a13a-e02bbb7462a1 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:49.540396 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12d2e-2998-45bc-9276-984d919040b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:49.541032 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12d2e-2998-45bc-9276-984d919040b9 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:49.541316 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12d2e-2998-45bc-9276-984d919040b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:49.541591 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12d2e-2998-45bc-9276-984d919040b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:49.548809 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12d2e-2998-45bc-9276-984d919040b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:49.550306 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12d2e-2998-45bc-9276-984d919040b9 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:49.557868 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 604/1203] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:49 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:44:49.965431 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342b52-ce60-4545-98ea-a7666a3894f1 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:49.965999 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342b52-ce60-4545-98ea-a7666a3894f1 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:49.966271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342b52-ce60-4545-98ea-a7666a3894f1 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:49.968492 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 600/1204] 10.222.0.26 () {54 vars in 962 bytes} [Sat Sep 3 20:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:44:49.974291 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:49.974586 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:49.974862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:49.997909 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:49.999467 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:50.012998 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 605/1205] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Sep 3 20:44:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:50.015904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958265-8afa-449c-848e-28cd16660cf6 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:50.016251 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958265-8afa-449c-848e-28cd16660cf6 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:50.016588 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958265-8afa-449c-848e-28cd16660cf6 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:50.018612 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 601/1206] 10.222.0.26 () {54 vars in 912 bytes} [Sat Sep 3 20:44:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:44:50.019612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:50.031779 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:50.032122 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:50.032462 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:50.054841 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:44:50.057789 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:50.069213 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 602/1207] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 3 20:44:50 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:44:50.082256 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:44:50.091753 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767489e-11ba-49e3-b6d4-66310a1c2bcd None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:50.096051 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9bd55-ebbc-491c-87ee-adb853783890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:50.096650 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9bd55-ebbc-491c-87ee-adb853783890 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:50.096962 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9bd55-ebbc-491c-87ee-adb853783890 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:50.097233 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9bd55-ebbc-491c-87ee-adb853783890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:50.106710 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e0026-d5aa-45d8-9dd1-3e9364cb1919 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:44:50.108607 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9bd55-ebbc-491c-87ee-adb853783890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:50.110086 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9bd55-ebbc-491c-87ee-adb853783890 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:50.112137 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:44:50.112745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:44:50.113054 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:44:50.113327 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:44:50.116397 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:44:50.121731 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 603/1208] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:44:50.129575 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:44:50.131184 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:44:50.144192 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 606/1209] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:44:50 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:45:00.115904 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=39 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:00.137133 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=64 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:00.476757 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa4a36-a289-496c-a69b-bdcdc3e8eb6d None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:00.477080 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa4a36-a289-496c-a69b-bdcdc3e8eb6d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:00.477352 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa4a36-a289-496c-a69b-bdcdc3e8eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:00.498243 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-a8aa4a36-a289-496c-a69b-bdcdc3e8eb6d None None] MFA Rules not processed for user `0a022837bc064674a9b648976e37f9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:45:00.499808 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-a8aa4a36-a289-496c-a69b-bdcdc3e8eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:45:00.507560 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 604/1210] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Sep 3 20:45:00 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:45:00.519959 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:45:00.529151 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7d87b-98d9-4107-97fc-a693ca46f942 service placement] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:45:00.534404 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c6c12-761d-45ad-a3fd-57011fdc689f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:45:00.535013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6c12-761d-45ad-a3fd-57011fdc689f service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:00.535289 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6c12-761d-45ad-a3fd-57011fdc689f service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:00.535558 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c6c12-761d-45ad-a3fd-57011fdc689f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:00.542882 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c6c12-761d-45ad-a3fd-57011fdc689f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:45:00.544336 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c6c12-761d-45ad-a3fd-57011fdc689f service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:45:00.552430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 607/1211] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:45:00 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:45:01.256358 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0f4f4-1b8b-4325-9bb5-32ea1092669d None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:01.256995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0f4f4-1b8b-4325-9bb5-32ea1092669d None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:01.256995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0f4f4-1b8b-4325-9bb5-32ea1092669d None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:01.258258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 605/1212] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:45:01.301889 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1093bfb-b2cb-4633-85d2-0b94c1dba4e5 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:01.302479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1093bfb-b2cb-4633-85d2-0b94c1dba4e5 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:01.302479 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1093bfb-b2cb-4633-85d2-0b94c1dba4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:01.323215 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-e1093bfb-b2cb-4633-85d2-0b94c1dba4e5 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:45:01.324571 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-e1093bfb-b2cb-4633-85d2-0b94c1dba4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:45:01.351867 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 608/1213] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:45:01 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:45:01.375911 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0f4f4-1b8b-4325-9bb5-32ea1092669d None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:45:01.390143 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0f4f4-1b8b-4325-9bb5-32ea1092669d None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:45:01.396141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cd622-e008-483b-8508-1555561fb305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:45:01.396815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd622-e008-483b-8508-1555561fb305 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:01.397304 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd622-e008-483b-8508-1555561fb305 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:01.397635 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cd622-e008-483b-8508-1555561fb305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:01.407352 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd622-e008-483b-8508-1555561fb305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:45:01.409394 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cd622-e008-483b-8508-1555561fb305 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:45:01.424982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 606/1214] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:45:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:45:06.510695 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608035d0-7f66-4e9b-89dd-bf3aaae932bc None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:06.511320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608035d0-7f66-4e9b-89dd-bf3aaae932bc None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:06.511320 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608035d0-7f66-4e9b-89dd-bf3aaae932bc None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:06.512630 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 609/1215] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:45:06.524408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:06.524995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:06.524995 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:06.545815 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:45:06.547138 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:45:06.561673 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 607/1216] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:45:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:45:06.573952 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608035d0-7f66-4e9b-89dd-bf3aaae932bc None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:45:06.587686 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608035d0-7f66-4e9b-89dd-bf3aaae932bc None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:45:06.599991 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c166a-c7e6-470a-9cab-85d0f035a347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:45:06.600612 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c166a-c7e6-470a-9cab-85d0f035a347 service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:06.600956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c166a-c7e6-470a-9cab-85d0f035a347 service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:06.601201 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c166a-c7e6-470a-9cab-85d0f035a347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:06.610288 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c166a-c7e6-470a-9cab-85d0f035a347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:45:06.611904 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c166a-c7e6-470a-9cab-85d0f035a347 service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:45:06.621821 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 610/1217] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:45:06 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:45:16.540402 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=12 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:16.617559 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=15 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:18.554066 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:45:18.563526 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c6ea-95f8-4d52-b5fc-f558c6d989fd None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:45:18.567760 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f47a7e-eb3c-463f-8b1c-bec92b83823e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:45:18.568370 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47a7e-eb3c-463f-8b1c-bec92b83823e service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:18.568654 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47a7e-eb3c-463f-8b1c-bec92b83823e service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:18.568958 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f47a7e-eb3c-463f-8b1c-bec92b83823e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:18.578871 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f47a7e-eb3c-463f-8b1c-bec92b83823e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:45:18.580396 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f47a7e-eb3c-463f-8b1c-bec92b83823e service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:45:18.590771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 608/1218] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:45:18 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:45:20.771670 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909cf76-1c26-4df4-ad9a-52baf245d113 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:20.772282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909cf76-1c26-4df4-ad9a-52baf245d113 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:20.772282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909cf76-1c26-4df4-ad9a-52baf245d113 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:20.773890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 611/1219] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:45:20.780563 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b821-b321-477a-9a2a-4e3c5e99d011 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:20.781224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b821-b321-477a-9a2a-4e3c5e99d011 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:20.781224 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20b821-b321-477a-9a2a-4e3c5e99d011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:20.811438 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-eb20b821-b321-477a-9a2a-4e3c5e99d011 None None] MFA Rules not processed for user `a5bb1cf8265243329e377e2d0a2112f5`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:45:20.812863 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-eb20b821-b321-477a-9a2a-4e3c5e99d011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:45:20.824987 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 609/1220] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:45:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:45:20.843360 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909cf76-1c26-4df4-ad9a-52baf245d113 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:45:20.870228 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909cf76-1c26-4df4-ad9a-52baf245d113 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:45:20.898890 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef093fc-40a4-4676-82fb-03df328e66cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:45:20.899519 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef093fc-40a4-4676-82fb-03df328e66cb service nova] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:20.899700 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef093fc-40a4-4676-82fb-03df328e66cb service nova] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:20.899921 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef093fc-40a4-4676-82fb-03df328e66cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:20.911770 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef093fc-40a4-4676-82fb-03df328e66cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:45:20.913406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef093fc-40a4-4676-82fb-03df328e66cb service nova] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:45:20.924366 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 612/1221] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:45:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:45:30.804518 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=9 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:30.920354 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=6 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:39.739372 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:39.739973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:39.739973 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:39.761661 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:45:39.762869 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:45:39.771421 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 610/1222] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:45:39 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:45:40.127595 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437aef5-fa3e-4495-9891-8c4a3565d0c8 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:40.128210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437aef5-fa3e-4495-9891-8c4a3565d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:40.128210 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437aef5-fa3e-4495-9891-8c4a3565d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:40.150309 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-4437aef5-fa3e-4495-9891-8c4a3565d0c8 None None] MFA Rules not processed for user `0a022837bc064674a9b648976e37f9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:45:40.151747 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-4437aef5-fa3e-4495-9891-8c4a3565d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:45:40.159521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 613/1223] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Sep 3 20:45:40 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:45:40.171776 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:45:40.187364 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704129c-54e9-41d7-b9e1-ab88ec2258e0 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:45:40.193227 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9676fc-0e5e-46e4-9299-ab50ff3af82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:45:40.194109 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9676fc-0e5e-46e4-9299-ab50ff3af82d service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:45:40.194405 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9676fc-0e5e-46e4-9299-ab50ff3af82d service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:45:40.194750 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9676fc-0e5e-46e4-9299-ab50ff3af82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:45:40.203412 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9676fc-0e5e-46e4-9299-ab50ff3af82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:45:40.204875 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9676fc-0e5e-46e4-9299-ab50ff3af82d service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:45:40.212971 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 611/1224] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:45:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:45:50.145188 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=3 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:45:50.209464 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=9 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:46:05.597994 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7f843-1394-4bd0-bd95-ed3b687acddf None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:46:05.598526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7f843-1394-4bd0-bd95-ed3b687acddf None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:46:05.598526 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7f843-1394-4bd0-bd95-ed3b687acddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:46:05.627673 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-ebe7f843-1394-4bd0-bd95-ed3b687acddf None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:46:05.628891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-ebe7f843-1394-4bd0-bd95-ed3b687acddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:46:05.637109 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 614/1225] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:46:05 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:46:15.620406 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=3 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:46:19.314211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:46:19.314703 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:46:19.314703 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:46:19.336504 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:46:19.337724 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:46:19.346908 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 612/1226] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:46:19 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:46:29.331603 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:47:15.960334 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fbc8-923b-480a-87b4-f2a1ecaa4d86 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:47:15.960897 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fbc8-923b-480a-87b4-f2a1ecaa4d86 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:47:15.960897 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fbc8-923b-480a-87b4-f2a1ecaa4d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:47:15.980891 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-07a7fbc8-923b-480a-87b4-f2a1ecaa4d86 None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:47:15.982095 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-07a7fbc8-923b-480a-87b4-f2a1ecaa4d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:47:15.989779 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 615/1227] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:47:25.975359 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=3 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:47:27.766479 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:47:27.788059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4af5bb-9547-49d6-8080-21ec3eb2b75b None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:47:27.792906 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b1e88-cee3-4b09-9285-8e84dfb78e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:47:27.793522 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b1e88-cee3-4b09-9285-8e84dfb78e8e service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:47:27.793797 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b1e88-cee3-4b09-9285-8e84dfb78e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:47:27.794068 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b1e88-cee3-4b09-9285-8e84dfb78e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:47:27.803632 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b1e88-cee3-4b09-9285-8e84dfb78e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:47:27.805120 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b1e88-cee3-4b09-9285-8e84dfb78e8e service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:47:27.815550 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 613/1228] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:47:27 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:47:37.810451 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=10 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:47:55.060091 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132adbdf-3b51-4266-940c-c9d99cfff3a0 None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:47:55.060865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132adbdf-3b51-4266-940c-c9d99cfff3a0 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:47:55.060865 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132adbdf-3b51-4266-940c-c9d99cfff3a0 None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:47:55.062683 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 616/1229] 10.222.0.26 () {54 vars in 961 bytes} [Sat Sep 3 20:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 20:47:55.068618 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247ea5-6c6d-467f-999a-bcba951d335e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:47:55.069183 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247ea5-6c6d-467f-999a-bcba951d335e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:47:55.069344 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247ea5-6c6d-467f-999a-bcba951d335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:47:55.146983 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-dd247ea5-6c6d-467f-999a-bcba951d335e None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:47:55.148335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-dd247ea5-6c6d-467f-999a-bcba951d335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:47:55.169982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 614/1230] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Sep 3 20:47:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:47:55.178022 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132adbdf-3b51-4266-940c-c9d99cfff3a0 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:47:55.194606 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132adbdf-3b51-4266-940c-c9d99cfff3a0 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:47:55.200001 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:47:55.200714 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:47:55.201185 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:47:55.201498 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:47:55.211691 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:47:55.213592 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:47:55.226862 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 617/1231] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:47:55 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:48:05.166192 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=22 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:48:05.221654 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=6 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:14.883710 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:49:14.884252 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:49:14.884366 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:49:14.905107 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] MFA Rules not processed for user `b00e4c42dc654f13864faf49f9927c54`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:49:14.906300 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:49:14.914740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 615/1232] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:49:14 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:49:24.899836 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=3 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:49:39.755127 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:49:39.774005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c7085-67e8-4f25-a9f5-760863c7e868 service placement] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:49:39.779732 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d69a6f-4914-4742-b095-fcc6ca048c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:49:39.780377 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69a6f-4914-4742-b095-fcc6ca048c3e service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:49:39.780655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69a6f-4914-4742-b095-fcc6ca048c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:49:39.780956 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69a6f-4914-4742-b095-fcc6ca048c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:49:39.791468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d69a6f-4914-4742-b095-fcc6ca048c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:49:39.792773 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d69a6f-4914-4742-b095-fcc6ca048c3e service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:49:39.803338 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 618/1233] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:49:39 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:49:42.836947 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:49:42.860567 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c71ab1-f057-4645-80c7-4654e55fe29e None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:49:42.866338 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:49:42.866938 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:49:42.867215 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:49:42.867480 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:49:42.875544 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:49:42.877177 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:49:42.887564 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 616/1234] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:49:42 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:49:47.773483 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:49:47.773963 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:49:47.774037 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:49:47.795614 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:49:47.796798 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:49:47.805913 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 619/1235] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:49:47 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:49:49.709083 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:49:49.719449 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e9f9f-03c3-47ca-8dc6-afcb8c72bd17 service nova] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:49:49.723301 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:49:49.724070 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:49:49.724349 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:49:49.724702 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:49:49.735620 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:49:49.737231 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:49:49.748072 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 617/1236] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:49:49 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 20:49:50.871927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:49:50.887588 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65aff1a-cc04-4220-8767-7a89170a96ad None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:49:50.891369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:49:50.891984 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:49:50.892260 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:49:50.892531 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:49:50.904655 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:49:50.906144 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:49:50.920797 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 620/1237] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:49:50 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:49:59.744771 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=16 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:00.913701 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=15 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:02.737895 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:50:02.748952 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14736008-12bc-4e47-95e8-9a302976502d service neutron] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:50:02.753891 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:50:02.754488 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:50:02.754762 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:50:02.755031 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:50:02.763963 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:50:02.765640 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:50:02.776287 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 618/1238] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:50:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:50:02.845721 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:50:02.854246 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6617-5f50-46c1-b304-ce7373d3acaa service neutron] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:50:02.858226 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:50:02.858819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:50:02.859089 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:50:02.859350 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:50:02.866987 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:50:02.868430 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:50:02.877101 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 621/1239] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:50:02 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:50:12.771669 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=6 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:12.874033 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=6 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:50:59.079662 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:50:59.091215 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb33f47-d51c-4845-bcd3-8709aa3cc5ef service nova] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:50:59.096506 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a15d-a8f7-4d69-86ea-225fd6d13187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:50:59.097112 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a15d-a8f7-4d69-86ea-225fd6d13187 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:50:59.097388 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a15d-a8f7-4d69-86ea-225fd6d13187 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:50:59.097657 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a15d-a8f7-4d69-86ea-225fd6d13187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:50:59.110292 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a15d-a8f7-4d69-86ea-225fd6d13187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:50:59.111943 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a15d-a8f7-4d69-86ea-225fd6d13187 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:50:59.123527 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 619/1240] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:50:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:51:00.452733 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:00.462829 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd49717-47c7-4a1f-a5e7-ee838d9569a1 service neutron] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:00.467923 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f80324-3dfc-447d-b4fd-318c0504bc5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:00.468557 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80324-3dfc-447d-b4fd-318c0504bc5a service neutron] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:00.468854 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80324-3dfc-447d-b4fd-318c0504bc5a service neutron] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:00.469129 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80324-3dfc-447d-b4fd-318c0504bc5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:00.537128 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f80324-3dfc-447d-b4fd-318c0504bc5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:00.538706 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f80324-3dfc-447d-b4fd-318c0504bc5a service neutron] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:00.559205 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 622/1241] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:51:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:51:04.078811 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25945385-e32d-4c5c-8c7a-3ea74bdb96a5 None None] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:04.079770 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25945385-e32d-4c5c-8c7a-3ea74bdb96a5 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:04.080070 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25945385-e32d-4c5c-8c7a-3ea74bdb96a5 None None] PATH_INFO: `/` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:04.081597 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 620/1242] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:51:04.107493 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eae7d2-05eb-4296-a80b-99d6fa111a97 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:04.108017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eae7d2-05eb-4296-a80b-99d6fa111a97 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:04.108017 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eae7d2-05eb-4296-a80b-99d6fa111a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:04.130959 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-b0eae7d2-05eb-4296-a80b-99d6fa111a97 None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:51:04.132194 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-b0eae7d2-05eb-4296-a80b-99d6fa111a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:04.143757 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 623/1243] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:51:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:51:04.161283 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25945385-e32d-4c5c-8c7a-3ea74bdb96a5 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:04.180706 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25945385-e32d-4c5c-8c7a-3ea74bdb96a5 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:04.186457 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29ca8f-2b76-479f-a044-bad576dfb36d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:04.187297 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29ca8f-2b76-479f-a044-bad576dfb36d service placement] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:04.188034 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29ca8f-2b76-479f-a044-bad576dfb36d service placement] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:04.188335 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29ca8f-2b76-479f-a044-bad576dfb36d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:04.198270 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29ca8f-2b76-479f-a044-bad576dfb36d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:04.199941 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29ca8f-2b76-479f-a044-bad576dfb36d service placement] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:04.211271 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 621/1244] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:51:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:51:07.390005 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c501-b0ed-42b1-8722-e52a4706376f None None] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:07.390540 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c501-b0ed-42b1-8722-e52a4706376f None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:07.390627 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c501-b0ed-42b1-8722-e52a4706376f None None] PATH_INFO: `/` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:07.392699 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 624/1245] 10.222.0.26 () {54 vars in 921 bytes} [Sat Sep 3 20:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 20:51:07.425499 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] REQUEST_METHOD: `POST` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:07.426021 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:07.426278 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:07.450905 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.auth.core [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] MFA Rules not processed for user `abb0c39276f6470b92b022e1ea3ebc88`. Rule list: `[]` (Enabled: `True`). {{(pid=94930) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:51:07.452768 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:07.462427 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 622/1246] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Sep 3 20:51:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:51:07.470569 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1c501-b0ed-42b1-8722-e52a4706376f None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:07.486927 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1c501-b0ed-42b1-8722-e52a4706376f None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:07.487862 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:07.491681 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:07.492448 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:07.492794 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:07.493162 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] PATH_INFO: `/v3/users/b00e4c42dc654f13864faf49f9927c54` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:07.496760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00e4c42dc654f13864faf49f9927c54)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:07.499654 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: WARNING py.warnings [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:51:07.499654 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: warnings.warn(msg) Sep 03 20:51:07.499654 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: Sep 03 20:51:07.500939 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:07.503959 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e73d74-45e7-440c-8e36-4c05ca501b28 None None] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:07.510258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:07.511188 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:07.511569 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:07.511881 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:07.523785 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:07.525517 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:07.536217 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 623/1247] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:51:07 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:51:07.579521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00e4c42dc654f13864faf49f9927c54'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.601977 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00e4c42dc654f13864faf49f9927c54'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.602758 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00e4c42dc654f13864faf49f9927c54'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.617326 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00e4c42dc654f13864faf49f9927c54'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.626265 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00e4c42dc654f13864faf49f9927c54'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.634263 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 625/1248] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 3 20:51:07 2022] DELETE /identity/v3/users/b00e4c42dc654f13864faf49f9927c54 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:51:07.832316 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:07.851365 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e6a2b-abc9-40de-a183-8d14cd90a0ff service placement] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:07.914263 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:07.914886 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:07.915160 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:07.915426 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] PATH_INFO: `/v3/projects/dab54805412b4127823b601e3d8092b7` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:07.916892 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab54805412b4127823b601e3d8092b7)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:07.917988 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: WARNING py.warnings [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 20:51:07.917988 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: warnings.warn(msg) Sep 03 20:51:07.917988 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: Sep 03 20:51:07.919452 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:07.978110 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab54805412b4127823b601e3d8092b7', 'request_id': 'req-258c19b9-17bb-4c13-87de-97818f38d49f'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.986146 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab54805412b4127823b601e3d8092b7', 'request_id': 'req-258c19b9-17bb-4c13-87de-97818f38d49f'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:07.999660 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab54805412b4127823b601e3d8092b7', 'request_id': 'req-258c19b9-17bb-4c13-87de-97818f38d49f'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.013711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] The token cache is being invalidate because project dab54805412b4127823b601e3d8092b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 20:51:08.014000 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.014703 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.016334 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 624/1249] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 3 20:51:07 2022] DELETE /identity/v3/projects/dab54805412b4127823b601e3d8092b7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:51:08.020745 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:08.022248 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:08.041726 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f819b5-059a-4609-9b3f-83aae51d0173 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:08.104917 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:08.117685 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:08.118374 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:08.118776 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:08.119148 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] PATH_INFO: `/v3/users/27fc4ee4837b4cbdb496d1520ff44dc4` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:08.120468 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fc4ee4837b4cbdb496d1520ff44dc4)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:08.124282 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:08.175947 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fc4ee4837b4cbdb496d1520ff44dc4'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.190394 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fc4ee4837b4cbdb496d1520ff44dc4'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.191240 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fc4ee4837b4cbdb496d1520ff44dc4'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.199165 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fc4ee4837b4cbdb496d1520ff44dc4'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.207175 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-a3f6c009-416a-481f-8f68-b8add0816296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fc4ee4837b4cbdb496d1520ff44dc4'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.213647 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 626/1250] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 3 20:51:08 2022] DELETE /identity/v3/users/27fc4ee4837b4cbdb496d1520ff44dc4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:51:08.400478 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:08.402266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:08.419033 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c19b9-17bb-4c13-87de-97818f38d49f admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:08.466642 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:08.483184 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:08.483840 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] REQUEST_METHOD: `DELETE` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:08.484136 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:08.484408 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] PATH_INFO: `/v3/projects/7f91c36fabea4c929d3aaa55c1951039` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:08.485559 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f91c36fabea4c929d3aaa55c1951039)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:08.487493 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:08.535268 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f91c36fabea4c929d3aaa55c1951039', 'request_id': 'req-144cdb6e-804c-4cf3-a336-b7809c5276db'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.541110 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f91c36fabea4c929d3aaa55c1951039', 'request_id': 'req-144cdb6e-804c-4cf3-a336-b7809c5276db'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.547543 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f91c36fabea4c929d3aaa55c1951039', 'request_id': 'req-144cdb6e-804c-4cf3-a336-b7809c5276db'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.562701 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] The token cache is being invalidate because project 7f91c36fabea4c929d3aaa55c1951039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 20:51:08.562975 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.563667 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:51:08.565474 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 625/1251] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 3 20:51:08 2022] DELETE /identity/v3/projects/7f91c36fabea4c929d3aaa55c1951039 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:51:18.210007 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:18.559839 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:51:54.130121 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] REQUEST_METHOD: `POST` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:54.130688 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:54.130688 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:54.152465 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.auth.core [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] MFA Rules not processed for user `7f45705abc4449acae31dd145676d0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=94931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 20:51:54.153617 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:54.211125 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 627/1252] 10.222.0.26 () {58 vars in 958 bytes} [Sat Sep 3 20:51:54 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 20:51:54.552601 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:54.554235 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:54.621362 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cdb6e-804c-4cf3-a336-b7809c5276db admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:54.628540 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:54.629413 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:54.629742 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:54.630068 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:54.633389 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:54.646934 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:54.648371 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:54.656591 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 626/1253] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:51:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:51:56.165409 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:51:56.166934 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:56.242167 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b742f-bf0e-46a4-852b-dd32e160b199 None None] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:51:56.247071 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:51:56.247676 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:51:56.247949 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:51:56.248216 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:51:56.250044 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:51:56.261883 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:51:56.263536 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:51:56.274385 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 628/1254] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:51:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:52:04.653308 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=26 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:04.765500 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:52:04.767310 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:52:04.848258 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450fe5-3694-456e-896b-27224bde2338 service neutron] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:52:04.854059 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5bb1cf8265243329e377e2d0a2112f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:52:04.854711 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:52:04.854994 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:52:04.855266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:52:04.857092 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:52:04.869266 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:52:04.870913 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:52:04.881434 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 627/1255] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:52:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:52:06.269411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=57 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:14.877006 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=32 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:52:57.765499 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:52:57.767182 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:52:57.844521 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fe486-ca45-4537-ab1a-443f8a1d119c service placement] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:52:57.850819 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:52:57.851684 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:52:57.851974 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:52:57.852262 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:52:57.854415 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:52:57.867661 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:52:57.869347 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:52:57.880703 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 629/1256] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:52:57 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:53:07.876331 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=28 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:33.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:54:33.662081 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c7512-a136-4f3b-b200-2d955ea7c2f7 service nova] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:54:33.665978 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a022837bc064674a9b648976e37f9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:54:33.666587 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] REQUEST_METHOD: `GET` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:54:33.666870 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:54:33.667141 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:54:33.668945 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:54:33.755203 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:54:33.756658 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:54:33.766429 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 628/1257] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:54:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:54:40.001088 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:54:40.002760 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:54:40.017567 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6460-c72d-4e07-a5e6-3975281621e1 service placement] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:54:40.023169 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:54:40.023804 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:54:40.024077 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:54:40.024345 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] PATH_INFO: `/v3/users/7f45705abc4449acae31dd145676d0fe` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:54:40.039505 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f45705abc4449acae31dd145676d0fe)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:54:40.041542 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:54:40.092369 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f45705abc4449acae31dd145676d0fe'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.107660 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f45705abc4449acae31dd145676d0fe'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.108376 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f45705abc4449acae31dd145676d0fe'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.115681 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f45705abc4449acae31dd145676d0fe'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.126892 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f45705abc4449acae31dd145676d0fe'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.133775 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 630/1258] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 3 20:54:39 2022] DELETE /identity/v3/users/7f45705abc4449acae31dd145676d0fe => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:54:40.317605 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:54:40.327623 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5440c8c-f825-4621-830f-9d4a25fe4014 service neutron] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:54:40.389960 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:54:40.390482 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:54:40.390783 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:54:40.391054 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] PATH_INFO: `/v3/projects/6dafddda9c34412dad0d72ac51f50426` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:54:40.402599 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dafddda9c34412dad0d72ac51f50426)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:54:40.404521 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:54:40.452821 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dafddda9c34412dad0d72ac51f50426', 'request_id': 'req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.458348 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:40.459874 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dafddda9c34412dad0d72ac51f50426', 'request_id': 'req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.467399 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dafddda9c34412dad0d72ac51f50426', 'request_id': 'req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.480466 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] The token cache is being invalidate because project 6dafddda9c34412dad0d72ac51f50426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 20:54:40.480739 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.481387 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.483093 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 629/1259] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:40 2022] DELETE /identity/v3/projects/6dafddda9c34412dad0d72ac51f50426 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:54:40.487380 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:54:40.489329 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:54:40.503315 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef5376-86e5-42d3-822f-158c74698e00 admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:54:40.560494 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:54:40.561186 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:54:40.561464 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:54:40.561756 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] PATH_INFO: `/v3/users/0eaeec6dec2f4c36b2d959859b87badd` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:54:40.574971 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaeec6dec2f4c36b2d959859b87badd)` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:54:40.576975 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:54:40.627674 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaeec6dec2f4c36b2d959859b87badd'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.633629 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:40.644303 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaeec6dec2f4c36b2d959859b87badd'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.645301 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaeec6dec2f4c36b2d959859b87badd'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.652416 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaeec6dec2f4c36b2d959859b87badd'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.662034 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.notifications [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaeec6dec2f4c36b2d959859b87badd'} {{(pid=94931) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.668078 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 631/1260] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 3 20:54:40 2022] DELETE /identity/v3/users/0eaeec6dec2f4c36b2d959859b87badd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:54:40.853391 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Authenticating user token {{(pid=94930) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:54:40.854968 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.fernet_utils [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94930) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:54:40.868740 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd569f65-b6fb-4ea2-a33e-c24a56ccc8f1 admin admin] Validating token access rules against request {{(pid=94930) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:54:40.926186 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c7ada225bf4c9f83deb9a393935185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e71242b6cf459c81a02ac25c62a69e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94930) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:54:40.926935 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:54:40.927211 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] SCRIPT_NAME: `/identity` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:54:40.927481 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] PATH_INFO: `/v3/projects/d126f6e47c3742618d55b716f2778a0f` {{(pid=94930) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:54:40.939159 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d126f6e47c3742618d55b716f2778a0f)` {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:54:40.941151 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] RBAC: Authorization granted {{(pid=94930) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:54:40.992078 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd126f6e47c3742618d55b716f2778a0f', 'request_id': 'req-98fda24c-030d-4bb2-b2e2-d87770976518'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:40.997587 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd126f6e47c3742618d55b716f2778a0f', 'request_id': 'req-98fda24c-030d-4bb2-b2e2-d87770976518'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:41.004070 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd126f6e47c3742618d55b716f2778a0f', 'request_id': 'req-98fda24c-030d-4bb2-b2e2-d87770976518'} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:41.018097 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] The token cache is being invalidate because project d126f6e47c3742618d55b716f2778a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94930) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 20:54:41.018461 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:41.019132 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG keystone.notifications [None req-98fda24c-030d-4bb2-b2e2-d87770976518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94930) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 20:54:41.021119 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: [pid: 94930|app: 0|req: 630/1261] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 3 20:54:40 2022] DELETE /identity/v3/projects/d126f6e47c3742618d55b716f2778a0f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 20:54:50.664877 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:54:51.014971 dv-osbrick-master-4-ceph devstack@keystone.service[94930]: DEBUG dbcounter [-] [94930] Writing DB stats keystone:SELECT=60,keystone:INSERT=2,keystone:DELETE=8 {{(pid=94930) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 20:57:59.689411 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Authenticating user token {{(pid=94931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 20:57:59.691134 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:57:59.787245 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881147-ceae-4908-933c-b60bd5272a3a admin admin] Validating token access rules against request {{(pid=94931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 20:57:59.851437 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abb0c39276f6470b92b022e1ea3ebc88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b8683ad46dc4d7f8a4d1d52c90e3f81', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 20:57:59.852040 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] REQUEST_METHOD: `GET` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 20:57:59.852317 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] SCRIPT_NAME: `/identity` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 20:57:59.852587 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 20:57:59.854565 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.fernet_utils [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 20:57:59.866472 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 20:57:59.868050 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b100230-4ede-4f48-a18d-0a7d9c6bbca4 service placement] RBAC: Authorization granted {{(pid=94931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 20:57:59.877840 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: [pid: 94931|app: 0|req: 632/1262] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Sep 3 20:57:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 20:58:09.874013 dv-osbrick-master-4-ceph devstack@keystone.service[94931]: DEBUG dbcounter [-] [94931] Writing DB stats keystone:SELECT=67 {{(pid=94931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}